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Preface 


This book presents a comprehensive treatment of signals and linear systems 
suitable for juniors and seniors in electrical engineering. The book contains most of 
the material from my earlier popular book Linear Systems and Signals (1992) with 
added chapters on analog and digital filters and digital signal processing. There 
are also additional applications to communications and controls. The sequence of 
topics in this book is somewhat different from the earlier book. Here, the Laplace 
transform follows Fourier, whereas in the 1992 book, the sequence was the exact 
opposite. Moreover, the continuous-time and the discrete-time are treated sequen- 
tially, whereas in the 1992 book, both approaches were interwoven. The book 
contains enough material in discrete-time systems so that it can be used not only 
for a traditional course in Signals and Systems, but also for an introductory course 
in Digital Signal processing. 

A perceptive author has said: “The function of a teacher is not so much to 
cover the topics of study as to uncover them for the students.” The same can be 
said of a textbook. This book, as all my previous books, emphasizes the physical 
appreciation of concepts rather than mere mathematical manipulation of symbols. 
There is a temptation to treat an engineering subject, such as this, as a branch of 
applied mathematics. This view ignores the physical meaning behind various results 
and derivations, which deprives a student of intuitive understanding of the subject. 
I have used mathematics not so much to prove an axiomatic theory as to enhance 
the physical and intuitive understanding. Wherever possible, theoretical results 
are interpreted heuristicallyf and are supported by carefully chosen examples and 
analogies.! 

Notable Features 

The notable features of the book include the following: 

1 . Emphasis on intuitive and heuristic understanding of the concepts and physi- 
cal meaning of mathematical results leading to deeper appreciation and easier 
comprehension of the concepts. As one reviewer put it, “One thing I found very 
appealing about this book is great balance of mathematical and intuitive expla- 
nation.” Most reviewers of the book have noted the reader friendly character 
of the book with unusual clarity of presentation. 

2. The book provides extensive applications in the areas of communication, con- 
trols, and filtering. 

3. For those who like to get students involved with computers, computer solu- 
tions of several examples are provided using MATLAB®, which is becoming a 

f Heuristic [Greek heuriskein, to invent, discover]: a method of education in which the pupil is 
trained to find out things for himself. The word ‘Eureka’ (I have found it) is the 1st pers. perf. 
indie, act., of heuriskein. 

jlf these lines appear familiar to you, there is a good reason. I have used them in the preface of 
some of my earlier books, including Signals, Systems, and Communication (Wiley, 1965). What 
is more interesting, many other authors also have borrowed them for their preface. 
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standard software package in an electrical engineering curriculum. 

4. Many students are handicapped by an inadequate background in basic material 
such as complex numbers, sinusoids, sketching signals, Cramer’s rule, partial 
fraction expansion, and matrix algebra. I have added a chapter that addresses 
these basic and pervasive topics in electrical engineering. Response by student 
has been unanimously enthusiastic. 

5. There are over 200 worked examples along with exercises (with answers) for stu- 
dents to test their understanding. There are also about 400 selected problems 
of varying difficulty at the end of the chapters. Many problems are provided 
with hints to steer a student in the proper direction. 

6. The discrete-time and continuous-time systems are covered sequentially, with 
flexibility to teach them concurrently if so desired. 

7. The summary at the end of each chapter proves helpful to students in summing 
up essential developments in the chapter, and is an effective tool in the study 
for tests. Answers to selected problems are helpful in providing feedback to 
students trying to assess their knowledge. 

8. There are several historical notes to enhance student’s interest in the subject. 
These facts introduce students to historical background that influenced the 
development of electrical engineering. 

Organization 

The book opens with a chapter titled Background, which deals with the math- 
ematical background material that a student taking this course is expected to have 
already mastered. It includes topics such as complex numbers, sinusoids, sketching 
signals, Cramer’s rule, partial fraction expansion, matrix algebra. The next 7 chap- 
ters deal with continuous-time signals and systems followed by 5 chapters treating 
discrete-time signals and systems. The last chapter deals with state-space analysis. 
There are MATLAB examples dispersed throught the book. The book can be read- 
ily tailored for a variety of courses of 30 to 90 lecture hours. It can also be used as 
a text for a first undergraduate course in Digital signal Processing (DSP). 

The organization of the book permits a great deal of flexibility in teaching the 
continuous-time and discrete-time concepts. The natural sequence of chapters is 
meant for a sequential approach in which all the continuous-time analysis is cov- 
ered first, followed by discrete-time analysis. It is also possible to integrate (inter- 
weave) continuous-time and discrete-time analysis by using a appropriate sequence 
of chapters. 

Credits 

The photographs of Gauss (p. 3), Laplace (p. 380), Heaviside (p. 380), Fourier 
(p. 188), Michelson (p. 206) have been reprinted courtesy of the Smithsonian Insti- 
tution. The photographs of Cardano (p. 3) and Gibbs (p. 206) have been reprinted 
courtesy of the Library of Congress. Most of the MATLAB examples were prepared 
by Dr. 0. P. Mandhana of IBM, Austin, TX. 
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MATLAB 

Throughout this book, examples have been provided to familiarize the reader 
with computer tools for systems design and analysis using the powerful and versatile 
software package MATLAB. Much of the time and cost associated with the analysis 
and design of systems can be reduced by using computer software packages for 
simulation. Many corporations will no longer support the development systems 
without prior computer simulation and numerical results which suggest a design 
will work. The examples and problems in this book will assist the reader in learning 
the value of computer packages for systems design and simulation. 

MATLAB is the software package used throughout this book. MATLAB is a 
powerful package developed to perform matrix manipulations for system designers. 
MATLAB is easily expandable and uses its own high level language. These factors 
make developing sophisticated systems easier. In addition, MATLAB has been 
carefully written to yield numerically stable results to produce reliable simulations. 

All the computer examples in this book are verified to be compatible with the 
student edition of the MATLAB when used according to the instructions given in 
its manual. The reader should make sure that \MATLAB\BIN is added in the DOS 
search path. MATLAB can be invoked by executing the command MATLAB. The 
MATLAB banner will appear after a moment with the prompt “>>’. MATLAB has 
a useful on-line help. To get help on a specific command, type HELP COMMAND 
NAME and then press the ENTER key. DIARY FILE is a command to record all 
the important keyboard inputs to a file and the resulting output of your MATLAB 
session to be written on the named file. MATLAB can be used interactively, or 
by writing functions (subroutines) often called M files because of the .M extension 
used for these files. Once familiar with the basics of MATLAB, the reader can easily 
learn how to write functions and to use MATLAB’s existing functions. 

The MATLAB M-files have been created to supplement this text. This includes 
all the examples solved by MATLAB in the text. These M-files may be retrieved 
from the Mathworks anonymous FTP site at 

ftp: / /ftp.mathworks. com/pub/books/lathi/. 

O. P. Mandhana 
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Background 


The topics discussed in this chapter are not entirely new to students taking 
this course. You have already studied many of these topics in earlier courses or are 
expected to know them from your previous training. Even so, this background ma- 
terial deserves a review because it is so pervasive in the area of signals and systems. 
Investing a little time in such a review will pay big dividends later. Furthermore, 
this material is useful not only for this course but also for several courses that follow. 
It will also be helpful as reference material in your future professional career. 

B.l Complex Numbers 

Complex numbers are an extension of ordinary numbers and are an integral 
part of the modern number system. Complex numbers, particularly imaginary 
numbers, sometimes seem mysterious and unreal. This feeling of unreality de- 
rives from their unfamiliarity and novelty rather than their supposed nonexistence! 
Mathematicians blundered in calling these numbers “imaginary, for the term im- 
mediately prejudices perception. Had these numbers been called by some other 
name, they would have become demystified long ago, just as irrational numbers 
or negative numbers were. Many futile attempts have been made to ascribe some 
physical meaning to imaginary numbers. However, this effort is needless. In math- 
ematics we assign symbols and operations any meaning we wish as long as internal 
consistency is maintained. A healthier approach would have been to define a symbol 
i (with any term but “imaginary”), which has a property i 2 = -1. The history of 
mathematics is full of entities which were unfamiliar and held in abhorrence until 
familiarity made them acceptable. This fact will become clear from the following 
historical note. 

B.l-1 A Historical Note 

Among early people the number system consisted only of natural numbers 
(positive integers) needed to count the number of children, cattle, and quivers of 
arrows. These people had no need for fractions. Whoever heard of two and one-half 
children or three and one-fourth cows! 




2 


B.l Complex Numbers 


3 


Background 

However, with the advent of agriculture, people needed to measure continuously 
varying quantities, such as the length of a field, the weight of a quantity of butter, 
and so on. The number system, therefore, was extended to include fractions. The 
ancient Egyptians and Babylonians knew how to handle fractions, but Pythagoras 
discovered that some numbers (like the diagonal of a unit square) could not be 
expressed as a whole number or a fraction. Pythagoras, a number mystic, who 
regarded numbers as the essence and principle of all things in the universe, was so 
appalled at his discovery that he swore his followers to secrecy and imposed a death 
penalty for divulging this secret. 1 These numbers, however, were included in the 
number system by the time of Descartes, and they are now known as irrational 
numbers. 

Until recently, negative numbers were not a part of the number system. The 
concept of negative numbers must have appeared absurd to early man. However, 
the medieval Hindus had a clear understanding of the significance of positive and 
negative numbers. 2,3 They were also the first to recognize the existence of absolute 
negative quantities. 4 The works of Bhaskar (1114-1185) on arithmetic ( Lilavati ) 
and algebra ( Bijaganit ) not only use the decimal system but also give rules for deal- 
ing with negative quantities. Bhaskar recognized that positive numbers have two 
square roots. 5 Much later, in Europe, the banking system that arose in Florence and 
Venice during the late Renaissance (fifteenth century) is credited with developing 
a crude form of negative numbers. The seemingly absurd subtraction of 7 from 5 
seemed reasonable when bankers began to allow their clients to draw seven gold 
ducats while their deposit stood at five. All that was necessary for this purpose was 
to write the difference, 2, on the debit side of a ledger. 6 

Thus the number system was once again broadened (generalized) to include 
negative numbers. The acceptance of negative numbers made it possible to solve 
equations such as x + 5 = 0, which had no solution before. Yet for equations such as 
x 2 + 1 = 0, leading to x 2 = — 1, the solution could not be found in the real number 
system. It was therefore necessary to define a completely new kind of number 
with its square equal to -1. During the time of Descartes and Newton, imaginary 
(or complex) numbers came to be accepted as part of the number system, but 
they were still regarded as algebraic fiction. The Swiss mathematician Leonhard 
Euler introduced the notation i (for imaginary) around 1777 to represent \^-T. 
Electrical engineers use the notation j instead of i to avoid confusion with the 
notation i often used for electrical current. Thus 

i 2 = -l • 

and 

= ±j 

This notation allows us to determine the square root of any negative number. For 
example, 

\/— 4 = v / 4x = ±2j 

When imaginary numbers are included in the number system, the resulting 
numbers are called complex numbers. 

Origins of Complex Numbers 

Ironically (and contrary to popular belief), it was not the solution of a quadratic 
equation, such as x 2 + 1 = 0, but a cubic equation with real roots that made 



Gerolamo Cardano (left) and Karl Friedrich Gauss (right). 


imaginary numbers plausible and acceptable to early mathematicians. They could 
dismiss v^T as pure nonsense when it appeared as a solution to x 2 + 1 = 0 

because this equation has no real solution. But in 1545, Gerolamo Cardano of 
Milan published Ars Magna (The Great Art), the most important algebraic work of 
the Renaissance. In this book he gave a method of solving a general cubic equation 
in which a root of a negative number appeared in an intermediate step. According 
to his method, the solution to a third-order equation) 

x 3 + ox + 6 = 0 

is given by 



For example, to find a solution of x 3 + 6x - 20 = 0, we substitute a = 6 , b = -20 
in the above equation to obtain 

x= \/l0 + v / 108 + </l0- VT08 = v / 20.392 - v / 0.392 = 2 

We can readily verify that 2 is indeed a solution of x 3 + 6x - 20 = 0. But when 
Cardano tried to solve the equation x 3 - 15x — 4 = 0 by this formula, his solution 

fThis equation is known as the depressed cubic equation. A general cubic equation 

V 3 + py 2 + qy + r = 0 

can always be reduced to a depressed cubic form by substituting y — x — | . Therefore any general 
cubic equation can be solved if we know the solution to the depressed cubic. The depressed 
cubic was independently solved, first by Scipione del Ferro (1465-1526) and then by Niccolo 
Fontana (1499-1557). The latter is better known in the history of mathematics as Tartaglia 
(“Stammerer”). Cardano learned the secret of the depressed cubic solution from Tartaglia. He 
then showed that by using the substitution y = x — | , a general cubic is reduced to a depressed 
cubic. 
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was 


x = 




What was Cardano to make of this equation in the year 1545? In those days 
negative numbers were themselves suspect, and a square root of a negative number 
was doubly preposterous! Today we know that 


(2 ± j) 3 = 2 ± jll = 2 ± — 121 


Therefore, Cardano’s formula gives 


x = (2 + j) + (2 - j) = A 


We can readily verify that x = 4 is indeed a solution of x 3 - I5x - 4 = 0. Cardano 
tried to explain halfheartedly the presence of \/-121 but ultimately dismissed the 
whole enterprise as being “as subtle as it is useless.” A generation later, however, 
Raphael Bombelli (1526-1573), after examining Cardano’s results, proposed ac- 
ceptance of imaginary numbers as a necessary vehicle that would transport the 
mathematician from the real cubic equation to its real solution. In other words, 
while we begin and end with real numbers, we seem compelled to move into an 
unfamiliar world of imaginaries to complete our journey. To mathematicians of the 
day, this proposal seemed incredibly strange. 7 Yet they could not dismiss the idea 
of imaginary numbers so easily because this concept yielded the real solution of an 
equation. It took two more centuries for the full importance of complex numbers to 
become evident in the works of Euler, Gauss, and Cauchy. Still, Bombelli deserves 
credit for recognizing that such numbers have a role to play in algebra. 7 

In 1799, the German mathematician Karl Friedrich Gauss, at a ripe age 
of 22, proved the fundamental theorem of algebra, namely that every algebraic 
equation in one unknown has a root in the form of a complex number. He showed 
that every equation of the nth order has exactly n solutions (roots), no more and no 
less. Gauss was also one of the first to give a coherent account of complex numbers 
and to interpret them as points in a complex plane. It is he who introduced the 
term complex numbers and paved the way for general and systematic use of complex 
numbers. The number system was once again broadened or generalized to include 
imaginary numbers. Ordinary (or real) numbers became a special case of generalized 
(or complex) numbers. 

The utility of complex numbers can be understood readily by an analogy with 
two neighboring countries A and Y , as illustrated in Fig. B.l. If we want to travel 
from City a to City b (both in Country A), the shortest route is through Country Y, 
although the journey begins and ends in Country X . We may, if we desire, perform 
this journey by an alternate route that lies exclusively in X, but this alternate route 
is longer. In mathematics we have a similar situation with real numbers (Country 
A) and complex numbers (Country Y). All real-world problems must start with real 
numbers, and all the final results must also be in real numbers. But the derivation 
of results is considerably simplified by using complex numbers as an intermediary. 
It is also possible to solve all real-world problems by an alternate method, using 
real numbers exclusively, but such procedure would increase the work needlessly. 


B.l-2 Algebra of Complex Numbers 

A complex number (a, b) or a + j b can be represented graphically by a point 
whose Cartesian coordinates are (a, b) in a complex plane (Fig. B,2). Let us denote 
this complex number by z so that 
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Fig. B.l Use of complex numbers can reduce the work. 

z = a + jb (B.l) 

The numbers a and b (the abscissa and the ordinate) of .z are the real part and 
the imaginary part, respectively, of z. They are also expressed as 

Re z =■ a 

Im z = 6 

Note that in this plane all real numbers lie on the horizontal axis, and all imaginary 
numbers lie on the vertical axis. 

Complex numbers may also be expressed in terms of polar coordinates. If (r, 9) 
are the polar coordinates of a point z = a + jb (see Fig. B.2), then 

a — r cos 9 
b = r sin 9 

and 

z = a + jb = r cos 9 + jr sin 9 

= r(cos 9 + j sin 9) (B.2) 



Fig. B.2 Representation of a number in the complex plane. 
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The Euler formula states that 

e 3 ^ = cos 8 + j sin 8 

To prove the Euler formula, we expand e 3 ^, cos 8, and sin 8 using a Maclaurin series 


e 3 ® = 1 + j6 + 


m 2 , m 3 , m* , oe) s ^ m 


3! 


■ + 


4! + 5! 


0 4 0 5 0 6 


1 + 2! j 3! + 4! + J 5! 6! 


cos 8 = 1- 


8 2 0 4 fl 6 0 8 

2[ + 4f _ 6[ + 8T 

8 s 8 7 


Sin$ = e -3\ + 5\-T\ + ' 


6! 


Hence, it follows that 


Using (B.3) in (B.2) yields 


p 3 « = 


cos 8 + j sin 8 


z = a + jb 


(B.3) 


(B.4) 


Thus, a complex number can be expressed in Cartesian form a + jb or polar form 
re 3 ® with 


and 


a = r cos 8, 


b = r sin 8 


r = \/ a 2 + ft 2 , 



(B.5) 

(B.6) 


Observe that r is the distance of the point * from the origin. For this reason, 
r is also called the magnitude (or absolute value) of 2 and is denoted by \z\. 
Similarly 8 is called the angle of 2 and is denoted by Lz. Therefore 


and 

Also 


\z\ = r, Lz = 8 


1 _ 1 - b e -i e — 

2 re 3 ® r | 2 | 


Conjugate of a Complex Number 

We define 2 *, the conjugate of z = a + jb, as 


z” = a - jb = re 36 
= 


(B.7) 

(B.8) 



Fig. B.3 Understanding some useful identities in terms of re 34 . 

The graphical representation of a number 2 and its conjugate z* is depicted in Fig. 
B.2. Observe that 2 * is a mirror image of 2 about the horizontal axis. To find the 
conjugate of any number, we need only to replace j by —j in that number (which 
is the same as changing the sign of its angle). 

The sum of a complex number and its conjugate is a real number equal to twice 
the real part of the number: 

2 + 2 * = (a + jb) + (0 — jb) = 2a = 2 Re 2 (B.lOa) 

The product of a complex number 2 and its conjugate is a real number |z| 2 , 
the square of the magnitude of the number: 

22 * = (a + jb)(a — jb) = a 2 + 6 2 = |z| 2 (B.lOb) 

Understanding Some Useful Identities 

In a complex plane, re i6 represents a point at a distance r from the origin and 
at an angle 8 with the horizontal axis, as shown in Fig. B.3a. For example, the 
number -1 is at a unit distance from the origin and has an angle n or -ir (in fact, 
any odd multiple of ±7r), as seen from Fig. B.3b. Therefore, 

le ±37r = -1 

In fact, 

e ±jmr _ n i n t e g er (B.ll) 

The number 1, on the other hand, is also at a unit distance from the origin, but 
has an angle 2ir (in fact, ±2n7r for any integral value of n). Therefore, 

e ±j2nw _ i n jaeger (B.12) 

The number j is at unit distance from the origin and its angle is tt/2 (see Fig. B.3b). 
Therefore, 

e 3w/2 = j 

Similarly, 

e -W 2 = _ ; - 

e±W 2 


(B.9a) 

(B.9b) 


Thus 


= ±j 


(B.13a) 
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In fact, 

e =fcjnir/2 _ _j_j n = 1 , 5, 9, 13,- ■■ 

and 

e ±jm r/2 = Tj - n = 3, 7, 11, 15, - - 
These results are summarized in Table B.l. 


(B.13b) 

(B.13c) 


TABLE B.l 


r 

0 

ref* 


1 

0 

e j0 = 1 


1 

±7T 

e ±y* _ 


1 

±ri7T 

e ±jnw = -1 

n odd integer 

1 

±27T 

e ±j27T = i 


1 

±2n7r 

e ±j'2mr _ 1 

n integer 

1 

±tt/2 

e ±jir/2 _ ± j 


1 

±717t/2 

e ±jnn/2 _ ± j 

n = 1,5,9,13,... 

1 

±nn/2 

e ±jnir/2 =Tj 

n = 3,7,11,15,... 


This discussion shows the usefulness of the graphic picture of re i0 . This picture 
is also helpful in several other applications. For example, to determine the limit of 
e (a+jw)t ^ OC) w e note that 

e (a+ju/)t _ e at e jut 

Now the magnitude of e jut is unity regardless of the value of u or t because e^ wt = 
Te i e with r = 1. Therefore, e at determines the behavior of e ( a+ i u ’'> t as t — > oo and 


lim e (Q+Ja,)t = lim e at e jut = 
t-*oc t — »oo 



a < 0 
a > 0 


(B.14) 


In future discussions you will find it very useful to remember re je as a number at a 
distance r from the origin and at an angle 0 with the horizontal axis of the complex 
plane. 


A Warning About Using Electronic Calculators in Computing Angles 

From the Cartesian form a+jb we can readily compute the polar form re je [see 
Eq. (B.6)]. Electronic calculators provide ready conversion of rectangular into polar 
and vice versa. However, if a calculator computes an angle of a complex number 
using an inverse trigonometric function 0 = tan 1 (b/ a), proper attention must be 
paid to the quadrant in which the number is located. For instance, 0 corresponding 
to the number -2 - j 3 is tan _1 (rf)- This result is not the same as tan -1 (§). 
The former is -123.7°, whereas the latter is 56.3°. An electronic calculator cannot 
make this distinction and can give a correct answer only for angles in the first and 
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(c) (d) 

Fig. B.4 From Cartesian to polar form. 


fourth quadrants. It will read tan -1 (5§) as tan~'(§)> which is clearly wrong. In 
computing inverse trigonometric functions, if the angle appears in the second or 
third quadrant, the answer of the calculator is off by 180°. The correct answer is 
obtained by adding or subtracting 180° to the value found with the calculator (either 
adding or subtracting yields the correct answer). For this reason it is advisable to 
draw the point in the complex plane and determine the quadrant in which the point 
lies. This issue will be clarified by the following examples. 


■ Example B.l 

Express the following numbers in polar form: 

(a) 2 + j3 (b) —2 + jl (c) -2-jS (d) 1 - j3 


I = \/ 2 2 + 3 2 = \/l3 


= tan -1 (|) = 56.3° 


In this case the number is in the first quadrant, and a calculator will give the correct value 
of 56.3°. Therefore, (see Fig. B.4a) 


2+j3 = VT^ 56 ' 3 " 


\z\ = v /(— 2) 2 -I- l 2 = V5 Lz = tan 1 (^5) = 153.4° 


In this case the angle is in the second quadrant (see Fig. B.4b), and therefore the answer 
given by the calculator (tan -1 ^) = -26.6°) is off by 180°. The correct answer is 
(-26.6 ± 180)° = 153.4° or - 206.6°. Both values are correct because they represent the 
same angle. As a matter of convenience, we choose an angle whose numerical value is less 
than 180°, which in this case is 153.4°. Therefore, 


-2 + jl = V5e j ™ 4 ° 
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1*1 = V (- 2) 2 + (~ 3 ) 2 = V^13 Z* = tan '(r|) = ■ 


In this case the angle appears in the third quadrant (see Fig. B.4c), and therefore the 
answer obtained by the calculator (tan^rf) = 56.3°) is off by 180°. The correct answer 
is (56.3 ± 180)° = 236.3° or - 123.7°. As a matter of convenience, we choose the latter 
and (see Fig. B.4c) 

-2 - j3 = x/l3e _ ' ,123,7 ° 


|*| = t/io 


In this case the angle appears in the fourth quadrant (see Fig. B.4d), and therefore the 
answer given by the calculator (tan 1 ( ) = —71.6°) is correct (see Fig. B.4d). 

1 — j'3 = VTOe - '’ 71,6 ” ■ 


(2) Computer Example CB.l 

Express the following numbers in polar form: (a) 2 + j'3 (b) -2 + jl 

MATLAB function cart2pol(a.,b) can be used to convert the complex number a + jb 
to its polar form. 

(a) 

[Zangle-in_rad,Zmag]=cart2pol(2,3) 

Zangle_in_rad = 0.9828 
Zmag =3.6056 

Zangle_in_deg=Zangle_in-rad* (180/pi) 

Zangle_in_deg“56 . 31 
Therefore 

* = 2 + j3 = 3.6056e j56 ' 31 ° 


(b) , x 

[Zangle_in_rad,Zmag]=cart2pol(-2,l) 

Zangle_in_rad = 2.6779 
Zmag =2.2361 

Zangle Jn_deg=ZangleJn_rad*(180/pi) 

Zangle _m.de g~ 153 . 4349 
Therefore 

z= -2 + jl = 2.2361e jl53 4349 ° 

Note that MATLAB automatically takes care of the quadrant in which the complex number 
lies. O 

■ Example B.2 

Represent the following numbers in the complex plane and express them in Cartesian 
form: (a) 2e^ 3 (b) 4e~^ 4 (c) 2e^ J (d) Se^ 3 ’ (e) 2e^ (f) 2e^ 4 \ 

(a) 2e jK/3 = 2 (cos § + j sin § ) = 1 + j \/3 (see Fig. B.5a) 

(b) = 4 (cos %-j sin % ) = -2s/2 - j2^2 (see Fig. B.5b) 

(c) 2e jn/2 = 2 (cos § + j sin f ) = 2(0 + jl) = j2 (see Fig. B.5c) 

(d) 3e- j3,r = 3 (cos 3ir - j sin 3 tt) = 3(— 1 + j 0) = -3 (see Fig. B.5d) 

(e) 2e ,4,r = 2(cos 4ir + j sin 4 tt) = 2(1 + jO) = 2 (see Fig. B.5e) 

(f) 2e~ ii1 ’ = 2(cos 47r - j sin 4ir) = 2(1 - jO) = 2 (see Fig. B.5f) I 
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Fig. B.5 From polar to Cartesian form. 


Q Computer Example CB.2 

Represent 4e -j2? ~ in Cartesian form. 

MATLAB function pol2cart(0, r) converts the complex number re 1 to Cartesian form. 


[Zreal,Zimag]=pol2cart(-3*pi/4,4) 
Zreal— 2.8284 
Zimag=-2 .8284 
Therefore 

4e _j2 f = -2.8284- j'2.8284 


o 


Arithmetical Operations, Powers, and Roots of Complex Numbers 

To perform addition and subtraction, complex numbers should be expressed in 
Cartesian form. Thus, if 
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zj = 3 + j4 = 5e jS31 ° 

and 

z 2 = 2 + j3 = V / 13e- ) ' 56 ' 3 ° 

then 

z i + *2 = (3 + j'4) + (2 + j3) = 5 + j7 


If z\ and z 2 are given in polar form, we would need to convert them into Carte- 
sian form for the purpose of adding (or subtracting). Multiplication and division, 
however, can be carried out in either Cartesian or polar form, although the latter 
proves to be much more convenient. This is because if z\ and z 2 are expressed in 
polar form as 



zi = rie-^ 1 and z 2 = r 2 e^° 2 


then 

z\z 2 = (rie-’ 9 ') (r 2 ei e2 ) = rir 2 e^ 6l+e ^ 

(B.l 5a) 

and 

zr _ 

Z 2 r 2 ei e i r 2 

(B.15b) 

Moreover, 

z n = (re^)" = rV n# 

(B.15c) 

and 

z x ! n = (re j9 ) 1/n = r 1/n e j#/n 

(B.15d) 

This shows that the operations of multiplication, division, powers, 

and roots can be 


carried out with remarkable ease when the numbers are in polar form. 


I Example B.3 

Determine ziz 2 and Z 1 /Z 2 for the numbers 


zi = 3 + j'4 = 5e’ i3l ° 
zz = 2 + j'3 = \/l3e j563 ° 

We shall solve this problem in both polar and Cartesian forms. 

Multiplication: Cartesian Form 

*1*2 = (3 + j*4)(2 + jS) = (6 - 12) + j ( 8 + 9) = -6 + jl7 

Multiplication: Polar Form 

Z!Z 2 = (se 2 ' 531 ”) ^\/l3e j56,3 °) = 5Vl3e 2l09 4 ° 

Division: Cartesian Form 

zi _ 3 + ji 
Z2 2 + j3 

In order to eliminate the complex number in the denominator, we multiply both 
the numerator and the denominator of the right-hand side by 2 — j 3, the denominator’s 
conjugate. This yields 


zi (3 + j4)(2 — j3) = 18- jl _ 18- jl _ 18 _ .i_ 

z 2 (2 + j‘3) (2 — jZ) 2 2 + 3 2 13 13 3 13 

Division: Polar Form 

= ^ ej531 _ 5 ^j(53.1° —56.3° ) _ 5 c -j3.2° J 

z 2 ~ v/l3e 266 - 3 ° \/l3 yffi 

It is clear from this example that multiplication and division are easier to accom- 
plish in polar form than in Cartesian form. 

I Example B.4 

For zi = 2e ;,1r / 4 and z 2 = 8e J "^ 3 , find (a) 2zi - z 2 (b) T. ( c ) (d) 

(a) Since subtraction cannot be performed directly in polar form, we convert z\ and 
z 2 to Cartesian form: 

zr = — 2 (cos f + j sin |) = \/2 + jy/2 

z 2 = 8e-’* / ' 3 = 8 (cos § + jsin f) = 4 + j 4\/3 

Therefore, 

2zi - z 2 = 2(V2 + jV 2) - (4 + ji\/3) 

= (2%/2-4)+j(2%/2-4\/3) 

= -1.17- ;4.1 

1 1 2^ ^ —jir/ 4 

T\ ~ 2e^/ 4 ~ 2 6 

£i = 2e 2 ^ 4 2e 2 */ 4 = l_ = J_ 

z \ (8e^/ 3 ) 2 64e j2 ’ r,/3 32 32 

= z 4/3 = (8e 2 ^ 3 ) * = si (e 2 ' /3 ) 1/3 = 2e^' 9 ■ 

Q Computer Example CB.3 

Determine 212:2 and 2:1 /zi if z\ — 3 4- j 4 and 22 = 2 4- j3 
Multiplication and division: Cartesian Form 
zl=3+j*4; z2=2+j*3; 
zlz2=zl*z2 
zlz2— 6. 000+17. OOOOi 
zl_over_z2=zl/z2 
zl_over_z2=l . 3486-0. 0769i 
Therefore 


(*>) 

( c ) 

(d) 


(3 + ;4)(2 + ;3) = -6 + jl7 and (3 + j4)/(2 + j3) = 1.3486 - 0.0769 Q 
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H Example B.5 

Consider F(uj), a complex function of a real variable w: 

= (B.16a) 

(a) Express F(w) in Cartesian form, and find its real and imaginary parts, (b) 
Express F(w) in polar form, and find its magnitude F(w)| and angle ZF(w). 

(a) To obtain the real and imaginary parts of F(u i), we must eliminate imaginary 
terms in the denominator of F(w). This is readily done by multiplying both the numerator 
and denominator of F(w) by 3 - j4w, the conjugate of the denominator 3 + j'4w so that 


. (2 -t- /w)(3 — jiui) (6 + 4w 2 ) — /5w 6 + 4w 2 5w 

= (3 + j4w)(3 - j4u) ~ 9 + 16w 2 “ 9 + 16w 2 ~ 3 9 + w 2 


(B.16b) 


This is the Cartesian form of F(w). Clearly the real and imaginary parts F r (w) and Fi(w) 
are given by 


FA u) 


6 + 4w 2 
9 + 16w 2 ’ 


Fi(u>) 


— 5 W 

9 + 16w 2 


is the period. For the sinusoid in Eq. (B.18), C is the amplitude, To is the 
frequency (in Hertz), and 9 is the phase. Let us consider two special cases of this 
sinusoid when 6 = 0 and 9 = —tt/2 as follows: 


(a) /(f) = C cos 2ir T 0 t (6 = 0) 

(b) /(f) = C cos (2rr Jof — § ) = C sin 2xTot ( 9 -- — tt/2) 

The angle or phase can be expressed in units of degrees or radians. Although 
the radian is the proper unit, in this book we shall often use the degree unit because 
students generally have a better feel for the relative magnitudes of angles when 
expressed in degrees rather than in radians. For example, we relate better to the 
angle 24° than to 0.419 radians. Remember, however, when in doubt, use the 
radian unit and, above all, be consistent. In other words, in a given problem or an 
expression do not mix the two units. 

It is convenient to use the variable wo ( radian frequency ) to express 2 xTo: 

wo = 2tt To (B.20) 


(b) 


With this notation, the sinusoid in Eq. (B.18) can be expressed as 


F(w) = 


2 + jw 


3 + l' 4aJ V9 + 16w 2 ta " _1 (ir ) 


= /_4±ajf_^(un-«(f)-t«.->(V)] 

V 9 + 16w 2 


(B.16c) 


This is the polar representation of F(w). Observe that 


LF(u) = tan 1 - tan 1 (B.17) 


B.2 Sinusoids 

Consider the sinusoid 


/(f) = C cos (wot + 9) 

in which the period To is given by [see Eqs. (B.19) and (B.20)] 


and 


T - 1 _ HlL 

wo/2x wq 


(B.21a) 



(B.21b) 


In future discussions, we shall often refer to wo as the frequency of the signal 
cos (wot + 9), but it should be clearly understood that the frequency of this sinusoid 
is To Hz (To = wo/27r), and wo is actually the radian frequency. 

The signals C cos wo t and C sin wo t are illustrated in Figs. B.6a and B.6b re- 
spectively. A general sinusoid C cos (wo t + 6) can be readily sketched by shifting the 
signal C cos wot in Fig. B.6a by the appropriate amount. Consider, for example, 


f(t) = C cos (27rTot + 9) (B.18) 

We know that 

cos i p = cos (ip + 2n-7r) n = 0, ±1, ±2, ±3, • • • 

Therefore, cos y> repeats itself for every change of 27r in the angle <p. For the 
sinusoid in Eq. (B.18), the angle 27rTof + 9 changes by 2x when t changes by 
1 /Tq. Clearly, this sinusoid repeats every 1/T 0 seconds. As a result, there are 
To repetitions per second. This is the frequency of the sinusoid, and the repetition 
interval To given by 



/(t) = C cos (wot - 60°) 

This signal can be obtained by shifting (delaying) the signal C cos wot (Fig. B.6a) 
to the right by a phase (angle) of 60°. We know that a sinusoid undergoes a 360° 
change of phase (or angle) in one cycle. A quarter-cycle segment corresponds to 
a 90° change of angle. Therefore, an angle of 60° corresponds to two-thirds of a 
quarter-cycle segment. We therefore shift (delay) the signal in Fig. B.6a by two- 
thirds of a quarter-cycle segment to obtain C cos (wo t - 60°), as shown in Fig. B.6c. 

Observe that if we delay C cos wot in Fig. B.6a by a quarter-cycle (angle of 90° 
or 7r/2 radians), we obtain the signal C sin wo t, depicted in Fig. B.6b. This verifies 
the well-known trigonometric identity 

C cos (wot - \ ) = C sin wot 


(B.19) 


(B.22a) 
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C cos(0) 0 f-60‘) 


(c) 


Fig. B.6 Sketching a sinusoid. 

Alternatively, if we advance C sin wot by a quarter-cycle, we obtain C cos w 0 t. 
Therefore, 

C sin (wot + f ) = C cos u>o t (B.22b) 

This observation means sin wo t lags cos wot by 90°(tr/2 radians), or cos wot leads 
sin wo t by 90°. 

B.2-1 Addition of Sinusoids 

Two sinusoids having the same frequency but different phases add to form a 
single sinusoid of the same frequency. This fact is readily seen from the well-known 
trigonometric identity 

C cos (w 0 t + 6) = C cos $ cos wot - C sin 8 sin wo t 

= a cos wot + b sin wot (B.23a) 




in which 


a = C cos 9, 


b = -C sin 8 
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Fig. B.7 Phasor addition of sinusoids. 


Therefore, 


(B.23b) 


9 = tan- 1 j (B.23c) 

Equations (B.23b) and (B.23c) show that C and 6 are the magnitude and angle, 
respectively, of a complex number a - jb. In other words, a — jb = Ce^ e . Hence, to 
find C and 9 , we convert a - jb to polar form and the magnitude and the angle of 
the resulting polar number are C and 8, respectively. 


To summarize, 

a cos wot + b sin wot = C cos (wot + 8) 

in which C and 9 are given by Eqs. (B.23b) and (B.23c), respectively. These happen 
to be the magnitude and angle, respectively, of a - jb. 

The process of adding two sinusoids with the same frequency can be clarified 
by using phasors to represent sinusoids. We represent the sinusoid C cos (wot + 0) 
by a phasor of length C at an angle 9 with the horizontal axis. Clearly, the sinusoid 
a cos w 0 t is represented by a horizontal phasor of length a (9 = 0), while b sin wot = 
5 cos (wot - f ) is represented by a vertical phasor of length 6 at an angle -it/ 2 with 
the horizontal (Fig. B.7). Adding these two phasors results in a phasor of length C 
at an angle 9, as depicted in Fig. B.7. From this figure, we verify the values of C 
and 9 found in Eqs. (B.23b) and (B.23c), respectively. 

Proper care should be exercised in computing 9. Recall that tan _1 (^) / 
tan -1 (^j). Similarly, tan _1 (5|) ^ tan _1 (£). Electronic calculators cannot make 
this distinction. When calculating such an angle, it is advisable to note the quadrant 
where the angle lies and not to rely exclusively on an electronic calculator. A 
foolproof method is to convert the complex number a - jb to polar form. The 
magnitude of the resulting polar number is C and the angle is 9. The following 
examples clarify this point. 


I Example B.6 

In the following cases, express f(t) as a single sinusoid: 

(a) f(t) = cos wot - \/3sin wot 

(b) f(t) = — 3 cos wo< + 4 sin wot 

(a) In this case, a = 1,6 = —y/3, and from Eqs. (B.23) 


C = J l 2 + (%/3) 2 = 2 


9 = tan -1 = 60° 
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Therefore, 

/(f) = 2 cos (wot + 60°) 

We can verify this result by drawing phasors corresponding to the two sinusoids. The 
sinusoid cos too t is represented by a phasor of unit length at a zero angle with the horizontal. 
The phasor sin toot is represented by a unit phasor at an angle of —90° with the horizontal. 
Therefore, - 1/3 sin too t is represented by a phasor of length \/3 at 90° with the horizontal, 
as depicted in Fig. B.8a. The two phasors added yield a phasor of length 2 at 60° with 
the horizontal (also shown in Fig. B.8a). Therefore, 

/(t) = 2 cos (too t + 60°) 

Alternately, we note that a — jb = 1 + jV 3 = 2e :n/ ' 3 . Hence, C = 2 and 8 = 7r/3. 

Observe that a phase shift of ±tt amounts to multiplication by -1. Therefore, f(t) 
can also be expressed alternatively as 

/(t) = —2 cos (toot + 60° ± 180°) 

= —2 cos (toot — 120°) 

= —2 cos (toot + 240°) 

In practice, an expression with an angle whose numerical value is less than 180° is preferred, 
(b) In this case, a = -3,b = 4, and from Eqs. (B.23) 

C= yj (— 3) 2 + 42 . 5 
8 = tan' 1 (=$) = -126.9° 

Observe that 

tan" 1 (=|) 5* tan" 1 (f) = 53.1° 

Therefore, 

/(f) = 5 cos (tool — 126.9°) 

This result is readily verified in the phasor diagram in Fig. B.8b. Alternately, a - jb = 
-3- ji = 5e- jl26 ' 9 °. Hence, C = 5 and 8 = -126.9°. ■ 

Q Computer Example CB.4 

Express /(t) = -3 cos wot + 4sin wo t as a single sinusoid. 

Recall that <zcos wot + b sin wo t = C cos[wot + tan 1 (— 6/a)]. Hence, the amplitude C 
and the angle 8 of the resulting sinusoid are the magnitude and angle of a complex number 
a - jb. We use the ‘cart2pol’ function to convert it to the polar form to obtain C and 8. 

a=-3;b=4; 

[theta, C] =cart2pol(a,-b) ; 

Theta-deg=(180/pi)*theta; 

C,Theta_deg 

C=5 

Theta_deg= -126 . 8699 
Therefore 


—3 cos wot + 4 sin wot = 5 cos (wot — 126.8699°) 
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Fig. B.8 Phasor addition of sinusoids in Example B.6. 


We can also perform the reverse operation, expressing 
/(t) = C cos (wot + 8) 

in terms of cos wo t and sin wo t using the trigonometric identity 

C cos (wot + 8) = C cos 8 cos wo t - C sin 6 sin wot 

For example, 

10 cos (wo t - 60°) = 5 cos wot + 5\/3sin wo t 

Sinusoids in Terms of Exponentials: Euler’s Formula 

Sinusoids can be expressed in terms of exponentials using Euler’s formula [see 
Eq. (B.3)] 

cos <p = i ( e + e-™) (B.24a) 

sin ^ ( e - e-^) (B.24b) 

Inversion of these equations yields 

e-'f = cos < p + j sin ip (B.25a) 

e~ if — cos ip — j sin <p (B.25b) 

B.3 Sketching Signals 

In this section we discuss the sketching of a few useful signals, starting with 
exponentials. 

B.3-1 Monotonic Exponentials 

The signal e -ot decays monotonically, and the signal e at grows monotonically 
with t (assuming a > 0) as depicted in Fig. B.9. For the sake of simplicity, we shall 
consider an exponential e _at starting at f = 0, as shown in Fig. B.lOa. 

The signal e~ ai has a unit value at t = 0. At t = 1/a, the value drops to 

1/e (about 37% of its initial value), as illustrated in Fig. B.lOa. This time interval 
over which the exponential reduces by a factor e (that is, drops to about 37% of 
its value) is known as the time constant of the exponential. Therefore, the time 
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Fig. B.9 Monotonic exponentials. 


constant of e~ at is 1/a. Observe that the exponential is reduced to 37% of its initial 
value over any time interval of duration 1/a. This can be shown by considering any 
set of instants fj and t 2 separated by one time constant so that 

*2 - h = i 

Now the ratio of e ~ at 2 to e _atl is given by 

— <jf2 

f = --afta-tO _ l ss o.37 

e -ati * 



(a) < b > 

Fig. B.10 (a) Sketching e~ at (b) sketching e -2t . 


We can use this fact to sketch an exponential quickly. For example, consider 

/(f) = 

The time constant in this case is 1/2. The value of /(f) at t = 0 is 1. At t = 1/2 (one 
time constant) it is 1/e (about 0.37). The value of /(f) continues to drop further by 
the factor 1/e (37%) over the next half-second interval (one time constant), lhus 
/(f) at f = 1 is (1/e) 2 . Continuing in this manner, we see that /(f) = (1/e) at 
t = 3/2 and so on. A knowledge of the values of /(f) at t = 0, 0.5, 1, and 1.5 
allows us to sketch the desired signal) as shown in Fig. B.lOb. For a monotomcally 

tlf we wish to refine the sketch further, we could consider intervalsof half the time constant over 
which the signal decays by a factor 1/^- Thus, at t = 0.25, /(f) = l/y/i, and at t - 0.75, 
/(f) = 1/ei/e, etc. 
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Fig. B.ll Sketching an exponentially varying sinusoid 


growing exponential e a( , the waveform increases by a factor e over each interval of 
1/a seconds. 


B.3-2 The Exponentially Varying Sinusoid 

We now discuss sketching an exponentially varying sinusoid 
/(f) = Ae~ at cos (wot + 0) 

Let us consider a specific example 

/(f) = 4e~ 2t cos (6f - 60°) (B.26) 

We shall sketch 4e~ 24 and cos (6f - 60°) separately and then multiply them. 

(i) Sketching 4e _2t 

This monotonically decaying exponential has a time constant of 1/2 second 
and an initial value of 4 at f — 0. Therefore, its values at f — 0.5, 1, 1.5, and 2 
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are 4/e, 4/e 2 , 4/e 3 , and 4/e 4 , or about 1.47, 0.54, 0.2, and 0.07 respectively. Using 
these values as a guide, we sketch 4e _2t , as illustrated in Fig. B.lla. 

(ii) Sketching cos (6t - 60°) 

The procedure for sketching cos (6t - 60°) is discussed in Sec. B.2 (Fig. B.6c). 
Here the period of the sinusoid is T 0 = 2tt/ 6 « 1, and there is a phase delay of 60 
or two-thirds of a quarter-cycle, which is equivalent to about a (60/360)(1) « 1/6 
second delay (see Fig. B.llb). 

(iii) Sketching 4e _2t cos (6t - 60°) 

We now multiply the waveforms in (i) and (ii). The multiplication amounts to 
forcing the amplitude of the sinusoid cos (6* - 60°) to decrease exponentially with a 
time constant of 0.5. The initial amplitude (at t = 0) is 4, decreasing to 4/e (=1.47) 
at t = 0.5, to 1.47/e (=0.54) at t = 1, and so on. This is depicted in Fig. B.llc. 
Note that at the instants where cos (6t - 60°) has a value of unity (peak amplitude), 

4e~ 2t cos (6t - 60°) = 4e~ 2t ( B - 27 ) 

Therefore, 4 e - 2t cos(6f - 60°) touches 4 e - 2t at those instants where the sinusoid 
cos (6t - 60°) is at its positive peaks. Clearly 4e 2t is an envelope for positive 
amplitudes of 4 e - 2t cos(6 1 - 60°). Similarly, at those instants where the sinusoid 
cos (6t - 60°) has a value of -1 (negative peak amplitude), 

4e~ 2t cos (6t - 60°) = -4e- 2 ' ( B - 28 ) 

and 4e~ 2t cos (fit - 60°) touches -ie~ 2t at its negative peaks. Therefore, -4e~ 2 ' 
is an envelope for negative amplitudes of 4e 24 cos (6 1 - 60°). Thus, to sketch 
4e“ 2t cos ( 6t - 60°), we first draw the envelopes 4e 2 and -4e (the mirror image 
of 4e _2t about the horizontal axis), and then sketch the sinusoid cos (6t - 60°), with 
these envelopes acting as constraints on the sinusoid’s amplitude (see Fig. BTlc). 

In general, Ke~ at cos (w 0 t + 8) can be sketched in this manner, with Ke and 
—K e~ at constraining the amplitude of cos (u>o< + 8). 


B.4 Cramer’s Rule 

This is a very convenient rule used to solve simultaneous linear equations. 
Consider a set of n linear simultaneous equations in n unknowns *i, x 2 , ■ ■ ■, x n . 

aun + a 12^2 + ■ ■ * + “i n x n = y i 

021x1 + 0222:2 + 1- a 2 n x n = V2 (B 29) 


Unix 1 + a n2 x 2 + ■ • • + o, nn x n — y n 
These equations can be expressed in matrix form as 
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on 

“12 

a 21 

a 22 

, a nX 

«n2 


xi 2/1 

X 2 2/2 


We denote the matrix on the left-hand side formed by the elements aij as A. The 
determinant of A is denoted by |A|. If the determinant |A| is not zero, the set of 
equations (B.29) has a unique solution given by Cramer’s formula 

fc = l,2,...,n (B.31) 

where ]Djt| is obtained by replacing the fcth column of |A| by the column on the 
right-hand side of Eq. (B.30) (with elements y u y 2 , ■ ■ } In)- 
We shall demonstrate the use of this rule with an example. 

H Example B.7 . 

Using Cramer’s rule, solve the following simultaneous linear equations m three un- 
knowns: 

2X1 + X 2 + X 3 = 3 
Xl + 3X2 - X3 = 7 
Xl + X 2 + X3 = 1 

In matrix form these equations can be expressed as 

'2 1 1 ] rxil r3' 

13-1 X 2 = 7 


2 1 1 

|A| = 1 3 -1 =4 
1 1 1 

Since |A| = 4 # 0, a unique solution exists for xi, x 2 , and X3- This solution is provided 
by Cramer's rule (B.31) as follows: 

3 1 1 

1 , , , _ 8 _ 2 
Xl = |A| 7 3 _1 “ 4 _2 

1 1 1 

2 3 1 

--m 1 7 “-J- 
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2 1 3 

X3 = W\ 1 3 7 =T = - 2 ■ 

l l i 

Q Example CB.5 

Using a Computer, solve Example B.7. 

A = [2 1 ljl 3 -1;1 1 l]i b=[3 7 1]’; 

for k=l:3 

A1=A; 

Al(i,k)=bi 

D=A1; 

x(k)=det(D) /det(A); 
end 
x=x’ 
x - 2 
1 

-2 © 


B.5 Partial Fraction Expansion 


In the analysis of linear time-invariant systems, we encounter functions that 
are ratios of two polynomials in a certain variable, say x. Such functions are known 
as rational functions. A rational function F(x) can be expressed as 


b m x m + b m _iX m h bix + ftp 

x n -t- a„_ ix n-1 + ■ • • + a\x + ao 


(B.32) 


PM 

Q(x) 


(B.33) 


The function F(x ) is improper if m > n and proper if m < n. An improper 
function can always be separated into the sum of a polynomial in x and a proper 
function. Consider, for example, the function 


F(*) = 


2x 3 + 9x 2 + llx + 2 
x 2 + 4x + 3 


(B.34a) 


Because this is an improper function, we divide the numerator by the denominator 
until the remainder has a lower degree than the denominator. 


2x + 1 

x 2 + 4x + 3) 2x 3 + 9x 2 +llx + 2 
2x 3 + 8 x 2 +6x 

x 2 +5x -)- 2 
x 2 +4x + 3 
x — 1 


B.5 Partial Fraction Expansion 
Therefore, F(x) can be expressed as 
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2x 3 + 9x 2 + llx + 2 x — 1 

= = 2x + 1 H — - 

x 2 + 4x + 3 ' — v — ' x 2 + 4x + 3. 

polynomial in x ^ y 

proper function 


(B.34b) 


A proper function can be further expanded into partial fractions. The remaining 
discussion in this section is concerned with various ways of doing this. 

B.5-1 Partial Fraction Expansion: Method of Clearing Fractions 

This method consists of writing a rational function as a sum of appropriate par- 
tial fractions with unknown coefficients, which are determined by clearing fractions 
and equating the coefficients of similar powers on the two sides. This procedure is 
demonstrated by the following example. 

H Example B.8 

Expand the following rational function F(x) into partial fractions: 

Fix) = x 3 + 3x 2 + 4x + 6 
V ’ (x + l)(x + 2)(x + 3) 2 

This function can be expressed as a sum of partial fractions with denominators (x + 1), 
(x + 2), (x + 3), and (x + 3) 2 , as shown below. 

r/.i _ x 3 + 3x 2 + 4x + 6 _ *i i fc 2 , *3 * 4 

(x + l)(x + 2)(x + 3) 2 “ x + 1 x + 2 x + 3 + (x + 3) 2 

To determine the unknowns k\, k 2 , fc 3 , and kt we clear fractions by multiplying both sides 
by (x + l)(x + 2)(x + 3) 2 to obtain 

x 3 + 3x 2 + 4x + 6 = ki (x 3 + 8x 2 + 21x + 18) + k 2 (x 3 + 7x 2 + 15x + 9) 

+ k 3 (x 3 + 6x 2 + llx + 6) + k 4 (x 2 + 3x + 2) 

— x 3 (fci + k 3 + k 3 ) + x 2 (8ki + 7k 2 + 6k 3 + fc 4 ) 

+ x(21ki -i- 15k 2 + 11^3 + 3 k 4 ) + (18fci + 9^2 + 6k 3 -t- 2 k 4 ) 
Equating coefficients of similar powers on both sides yields 

ki + k 2 + k 3 — l 
8fci + 7fc 2 + Gk 3 + k 4 = 3 
21fei + 15*2 + 11*3 + 3* 4 = 4 
18*i + 9*2 + 6*3 + 2* 4 = 6 
Solution of these four simultaneous equations yields 


Therefore, 


*2 = - 2 , 


F(x) = — — + — 1 

w x + 1 x + 2 x + 3 (x + 3) 2 


Although this method is straightforward and applicable to all situations, it is 
not necessarily the most efficient. We now discuss other methods which can reduce 
numerical work considerably. 
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B.5-2 Partial Fractions: The Heaviside "Cover-Up” Method 
1. Unrepeated Factors of Q(x) 

We shall first consider the partial fraction expansion of F(x) = P(x)/Q(x ), in 
which all the factors of Q(x) are unrepeated. Consider the proper function 


brnX m + b m -\x m 1 + ■ ■ • + b\x + 6o 
x n + a n -ix n ~ 1 + ■ ■ ■ + aix + ao 

£(*) 

(x - \i)(x - A 2 ) • • • (x - A n ) 


(B.35a) 


We can show that F(x) in Eq. (B.35a) can be expressed as the sum of partial 
fractions 


To determine the coefficient fci, we multiply both sides of Eq. (B.35b) by x - A x 
and then let x = Aj. This yields 


, » m , . h(x- Ai) , fc 3 ( x-Ai) , , k n (x — Aj) 

(x - Ai)F(x) , = fci - 1 — r , — Y : — I +—, . .. 

* Al (x-Xi) (x — A 3 ) (x - A n ) x _ Al 

On the right-hand side, all the terms except fc 1 vanish. Therefore, 


*1 = (x - A!)F(x)| i=Xi 


Similarly, we can show that 


k r — (x X r )F(x)\ 3 .~^ r 


r = 1, 2, • • • , n 


I Example B.9 

Expand the following rational function F(x) into partial fractions: 

2x 2 + 9x-ll fci k 2 k3 

F(X) “ (x + l)(x - 2)(x + 3) ~x+lx~2x+3 

To determine fci, we let x = — 1 in {x + l)F(x). Note that (ic + l)F(x) is obtained 
from F(x) by omitting the term (x + 1) from its denominator. Therefore, to compute 
fci corresponding to the factor (x + 1), we cover up the term (x -t- 1) in the denominator 
of F(x) and then substitute x = — 1 in the remaining expression. (Mentally conceal the 
term (x + 1) in F(x) with a finger and then let x = -1 in the remaining expression.) The 
procedure is explained step by step below. 

F(x) = 2 * 2+9x - n - 
[ ’ (x + l)(x — 2)(x + 3) 

Step 1: Cover up (conceal) the factor (x + 1) from F(x): 


B.5 Partial Fraction Expansion 

2x 2 + 9x - 11 
|§x - 2)(x + 3) 

Step2: Substitute x = — 1 in the remaining expression to obtain fci: 


1 (— 1 — 2)(— 1 + 3) -6 

Similarly, to compute fo, we cover up the factor (x — 2) in F(x) and let x = 2 in the 
remaining function, as shown below. 


2x 2 + 9x - 11 


8 + 18-11 _ 15 _ l 


(x+immx + 3)\ „ (2 + 1)(2 + 3) 15 


2x 2 + 9x — 11 

M 


18-27-11 -20 

(-3 + 1) ( — 3 — 2) _ 10 


Therefore, 


F(x) = + _ = _i_ + _J 

K 1 (x + l)(x — 2)(x + 3) x + 1 x — 2 x + 3 


Complex Factors in F(x) 

The procedure above works regardless of whether the factors of Q(x) are real 
or complex. Consider, for example, 


F(x) = 


Similarly, 


4x 2 + 2x + 18 
(x + l)(x 2 + 4x + 13) 

4x 2 + 2x + 18 

(x + l)(x + 2 — j3)(x + 2 + j3) 

fci kj kj 

x + 1 x + 2 — j3 x + 2 + jZ 

4x 2 +^2x + 18 ‘ =2 


(x + 1) 


4x 2 + 2x + 18 ] = 1+j2 = V5eJ 6343 ° 

, .*«JB(x + 2+73)J i= -2+j3 


4x 2 + 2x + 18 


(x + l)(x + 2 - j3)| 


: 1 - j2 = y/Ee~ j63A3 ° 


Therefore, 


2 %/5 e f63- 43 ° V5e" j63 - 43 ° 

+ x + 2- j3 + x + 2 + j3 
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The coefficients k 2 and k$ corresponding to the complex conjugate factors are also 
conjugates of each other. This is generally true when the coefficients of a rational 
function are real. In such a case, we need to compute only one of the coefficients. 

2. Quadratic Factors 

Often we are required to combine the two terms arising from complex conjugate 
factors into one quadratic factor. For example, F(x) in Eq. (B.38) can be expressed 


. 4x 2 + 2x + 18 _ k 1 cix + C 2 

(x + l)(x 2 + 4x + 13) x + 1 x 2 + 4x + 13 

The coefficient ki is found by the Heaviside method to be 2. Therefore, 


4x 2 + 2x + 18 


ClX + C 2 


(x + l)(x 2 + 4x + 13) x + 1 x 2 + 4x + 13 

The values of cj and C 2 are determined by clearing fractions and equating the 
coefficients of similar powers of x on both sides of the resulting equation. Clearing 
fractions on both sides of Eq. (B.40) yields 


4x 2 -b 2a: -t- 18 = 2(x 2 + 4x + 13) -t- (c\x + C 2 )(x -+■ 1) 

= (2 + ci)x 2 + (8 + ci + C 2 )x + (26 + C 2 ) 
Equating terms of similar powers yields ci = 2, C 2 = -8, and 


4x 2 + 2x + 18 
(x + l)(x 2 + 4x + 13) 


: + 1 x 2 + 4x + 13 


Short-Cuts 

The values of ci and C 2 in Eq. (B.40) can also be determined by using short- 
cuts. After computing fci = 2 by the Heaviside method as before, we let x — 0 on 
both sides of Eq. (B.40) to eliminate c\. This gives us 


Therefore, 


15 = 2 + ^ 

13 13 


C2 — —8 


To determine ci, we multiply both sides of Eq. (B.40) by x and then let x — > 00 . 
Remember that when x — » 00 , only the terms of the highest power are significant. 
Therefore, 

4 = fcj + ci = 2 4- ci 


In the procedure discussed here, we let x = 0 to determine C 2 and then multiply 
both sides by x and let x — ► 00 to determine ci. However, nothing is sacred about 
these values (x = 0 or x = 00 ). We use them because they reduce the number of 
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coefficients a o, ai , 02 , . . ., a r _i, we multiply both sides of Eq. (B.45) by ( x — A) r . 
This gives us 

( x - \) r F (x) = ao + Oi(x - A) + 02 (x - A) 2 + ■ ■ ■ + a r _ \(x — A) r_1 

, (x — A) r , (x-A Y , (x — A) r /T> 

+ k\ (- &2 — t -i k n (B.46) 

x — a 1 x — 02 x — a n 

If we let x = A on both sides of Eq. (B.46), we obtain 

( x - A) r F(x) | l=A = a 0 (B.47a) 

Therefore, ao is obtained by concealing the factor (x - A) r in F(x) and letting 
x = A in the remaining expression (the Heaviside “cover up” method). If we take 
the derivative (with respect to x) of both sides of Eq. (B.46), the right-hand side is 
aj+ terms containing a factor (x - A) in their numerators. Letting x = A on both 
sides of this equation, we obtain 

£[(x-A) r F(x)]| = 01 

Thus, a\ is obtained by concealing the factor (x - A) r in F(x), taking the derivative 
of the remaining expression, and then letting x = A. Continuing in this manner, we 
find 


If-Kx- A) r F(x)] 
dx 3 *=A 


(B.47b) 


Observe that (x — A)T(x) is obtained from F{x) by omitting the factor (x - A) r 
from its denominator. Therefore, the coefficient a 3 is obtained by concealing the 
factor (x - A) r in F(x), taking the jth derivative of the remaining expression, and 
then letting x = A (while dividing by j!). 

I Example B.IO 

Expand F(x) into partial fractions if 


(x + l) 3 (x + 2) 


The partial fractions are 


F ( x ) = , a ° + ai + 

Kl (x + 1) 3 + (x + 1) 2 x + l^x + 2 

The coefficient k is obtained by concealing the factor (x + 2) in F(x) and then substituting 
x = — 2 in the remaining expression: 


To find ao, we conceal the factor (x + l) 3 in F(x) and let x = -1 in the remaining 


ao = 
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B.5-4 A Hybrid Method: Mixture of the Heaviside "Cover-Up" and 
Clearing Fractions 

For multiple roots, especially of higher order, the Heaviside expansion method, 
which requires repeated differentiation, can become cumbersome. For a function 
which contains several repeated and unrepeated roots, a hybrid of the two pro- 
cedures proves the best. The simpler coefficients are determined by the Heaviside 
method, and the remaining coefficients are found by clearing fractions or short-cuts, 
thus incorporating the best of the two methods. We demonstrate this procedure by 
solving Example B.IO once again by this method. 

In Example B.IO, coefficients k and a 0 are relatively simple to determine by 
the Heaviside expansion method. These values were found to be fei = 1 and ao = 2. 
Therefore, 

4x 3 + 16x 2 + 23x + 13 _ 2 ai 02 1 

(x + l) 3 (x -l- 2) (x + l) 3 (x + l) 2 x + 1 x + 2 

We now multiply both sides of the above equation by (x + l) 3 (x + 2) to clear the 
fractions. This yields 

4x 3 + 16x 2 +23x + 13 

— 2(x + 2) + aj(x + l)(x + 2) + 02 (x + l) 2 (x + 2) + (x + l) 3 
= (1 + a 2 )x 3 + (ai + 4a2 + 3)x 2 + (5 + 3aj + 5a2)x + (4 + 2aj + 2a2 + 1) 

Equating coefficients of the third and second powers of x on both sides, we obtain 

1 + 02 =4 
ai + 4a2 + 3 =16 

We may stop here if we wish because the two desired coefficients, a\ and 02 , are 
now determined. However, equating the coefficients of the two remaining powers of 
x yields a convenient check on the answer. Equating the coefficients of the x 1 and 
x° terms, we obtain 

23 = 5 + 3a 1 + 5a2 
13 = 4 + 2ai + 2a2 4- 1 
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These equations are satisfied by the values 01 = 1 and a 2 - 3, found earlier, 
providing an additional check for our answers. Therefore, 

2 1 3 1 

F = (x + l) 3 + (x + lj 2 + x + 1 + X + 2 

which agrees with the previous result. 

A Mixture of the Heaviside "Cover-Up" and Short Cuts 

In the above example, after determining the coefficients a 0 = 2 and k = 1 by 
the Heaviside method as before, we have 


4x 3 + 16x 2 + 23x + 13 _ 2 _ ^ Qi + + _L_ 

(x+-l) 3 (x + 2) (x + 1) 3 (x + 1 ) 2 1 + 1 1 + 2 

There are only two unknown coefficients, a x and a 2 - If we multiply both sides of 
the above equation by x and then let x - oo, we can eliminate 0l . This yields 


4 = 0-2 + 1 


Therefore, 


4x 3 + 16x 2 + 23x + 13 _ _2 , + JL_ + _L_ 

(js + i)3(7T2) (x + 1) 3 (x + 1) 2 * + l x + 2 

There is now only one unknown a x , which can be readily found by setting x equal 
to any convenient value, say x = 0. This yields 


^=2 + ai+3+| => oi = l 

which agrees with our earlier answer. 

B.5-5 Improper F(x) with m = n 

A general method of handling an improper function is indicated in the begin- 
ning of this section. However, for a special case where the numerator and denom- 
inator polynomials of F(x) are of the same degree : (m = n), the procedure is th 
same as that for a proper function. We can show that for 


F(x) = 


b n x n + 6n-is n ~ 1 + -" + M + fro 
x n + fln-ix"- 1 + ■ • ■ + aix + a 0 


kl fcj . fcn 

~ n+ X-\l x - A 2 X - An 

the coefficients fci, fc 2 , . . . , k„ are computed as if F{x) were proper. Thus, 


k r — (x — A r )F(x)l x== ^ r 


For quadratic or repeated factors, the appropriate procedures discussed in Secs. 
B.5-2 or B.5-3 should be used as if F(x) were proper. In other words, when m n, 
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the only difference between the proper and improper case is the appearance of an 
extra constant b„ in the latter. Otherwise the procedure remains the same. The 
proof is left as an exercise for the reader. 

H Example B.ll 

Expand JF’(x) into partial fractions if 


3x 2 + 9x - 20 _ 3s 2 + 9s - 20 
n x ) = I 2 + x _6 ' ~ (x - 2)(x + 3) 

Here m = n = 2 with b n = 62 = 3. Therefore, 


w \ 3x 2 -t- x - 20 _ _fci_ , 

F W~ (x-2)(x + 3) i-2 x + 3 




12 + 18 - 20 _ 10 _ 2 
(2 + 3) 5 


Therefore, 


3x 2 + 9x - 20 
(x-2 )B || 


27- 27-20 _ -20 
(-3-2) ~ -5 


, 3x 2 + 9x - 20 _ J2_ _4_ 

F ^~ (x-2)(x + 3) x — 2 x + 3 


B.5-6 Modified Partial Fractions 

Often we require partial fractions of the form ratlier than (i-bi) r ' T * 1 ’ s 

can be achieved by expanding F(x)/x into partial fractions. Consider, for example, 


F(x) = 


5x 2 + 20x + 18 


(x + 2)(x + 3) 2 

Dividing both sides by x yields 

F(x) 5x 2 + 20x + 18 
x x(x + 2)(x + 3) 2 

Expansion of the right-hand side into partial fractions as usual yields 

F[x) 5x 2 + 20x + 18 _ 01 L as g 3 + a4 _ 

~~x x(x + 2)(x + 3) 2 X x + 2 (x + 3) (x + 3) 2 
Using the procedure discussed earlier, we find oi = l, 02 = 1, 03 — -2, and a 4 — 1. 
Therefore, 

F(x) _ 1 , _1 + 

x x + x + 2 x + 3 (x + 3) 2 

Now multiplying both sides by x yields 

x 2x x 

F(i) = 1 + ^T2~ x + 3 + (x + 3) 2 

This expresses F(x) as the sum of partial fractions having the form (^rf-yr- 
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B.6 Vectors and Matrices 

An entity specified by n numbers in a certain order (ordered n-tuple) is an 
n-dimensional vector. Thus, an ordered n-tuple (in 12 , ■■■, x n ) represents an 
n-dimensional vector x. Vectors may be represented as a row (row vector). 

x = [zi 12 • • • x n ] 

or as a column (column vector): 


Simultaneous linear equations can be viewed as the transformation of one vector 
into another. Consider, for example, the n simultaneous linear equations 

y i = auij + 01212 + 1 • ■ + “ln^n 

1/2 = 02111 + 022^2 + • ■ ■ + a 2n x n 


Vm = a m ili + a m 2 I 2 + ■ ' ' + a mn x n 
If we define two column vectors x and y as 


then Eqs. (B.48) may be viewed as the relationship or the function that transforms 
vector x into vector y. Such a transformation is called the linear transformation 
of vectors. In order to perform a linear transformation, we need to define the array 
of coefficients ay appearing in Eqs. (B.48). This array is called a matrix and is 
denoted by A for convenience: 


“n 

a\2 • • 

a ln 

021 

a22 • ' 

• a 2n 



(B.50) 

a m\ 

a m2 

• ■ a mn 
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A matrix with m rows and n columns is called a matrix of the order (m,n) or an 
(m x n) matrix. For the special case where m = n, the matrix is called a square 
matrix of order n. 

It should be stressed at this point that a matrix is not a number such as a 
determinant, but an array of numbers arranged in a particular order. It is convenient 
to abbreviate the representation of matrix A in Eq. (B.50) with the form (a»j)mxn, 
implying a matrix of order mxn with ay as its ij'th element. In practice, when the 
order mxnis understood or need not be specified, the notation can be abbreviated 
to (ay). Note that the first index i of ay indicates the row and the second index j 
indicates the column of the element ay in matrix A. 

The simultaneous equations (B.48) may now be expressed in a symbolic form 

as 

y = Ax (B.51) 

or 

y j ail cl\2 ’ ' ‘ a ln x l 

V2 “21 “22 • ■ ■ a 2n *2 ^ 

,!/mJ La m l a m 2 ••• a mn J \_x n _ 

Equation (B.51) is the symbolic representation of Eq. (B.48). As yet, we have not 
defined the operation of the multiplication of a matrix by a vector. The quantity 
Ax is not meaningful until we define such an operation. 

B.6-1 Some Definitions and Properties 

A square matrix whose elements are zero everywhere except on the main diag- 
onal is a diagonal matrix. An example of a diagonal matrix is 

■2 0 0 

0 10 

.0 0 5 

A diagonal matrix with unity for all its diagonal elements is called an identity 
matrix or a unit matrix, denoted by I. Note that this is a square matrix: 

■100 o- 
0 10-0 

1= 0 0 1 - 0 (B.53) 


LO 0 0 ••• lJ 

The order of the unit matrix is sometimes indicated by a subscript. Thus, I„ 
represents the n x n unit matrix (or identity matrix). However, we shall omit the 
subscript. The order of the unit matrix will be understood from the context. 
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A matrix having all its elements zero is a zero matrix. 

A square matrix A is a symmetric matrix if ay = a jt (symmetry about the 
main diagonal). 

Two matrices of the same order are said to be equal if they are equal element 
by element. Thus, if 

A = (aij) m xn and B = (by) mX n 

then A = B only if ay = by for all i and j. 

If the rows and columns of an m x n matrix A are interchanged so that the 
elements in the ith. row now become the elements of the ith column (for i — 1. 2, 
... ,m), the resulting matrix is called the transpose of A and is denoted by A . 
It is evident that A T is an n x m matrix. For example, if 


•2 1 - 

A = 3 2 then A T = 


2 3 1 
1 2 3 


Thus, if 

then 

Note that 


A — (ay )mxn 
A T = (aji)nxm 

(A t ) t = A 


B.6-2 Matrix Algebra 

We shall now define matrix operations, such as addition, subtraction, multipli- 
cation, and division of matrices. The definitions should be formulated so that they 
are useful in the manipulation of matrices. 

1. Addition of Matrices 

For two matrices A and B, both of the same order (m x n), 


an 

ai2 • 

* <*ln 

'bn 

bi2 ' 

n 

<*21 

<*22 ’ 

• <*2n 

b2i 

b 2 2 

• &2n 



and B = 




_ <*m 1 

<*m2 

<*mn . 

. frjnl 

&m2 

bmn . 


we define the sum A + B as 
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A + B = 


' (ail + hi) (012 + & 12 ) ■" (“in + bin) 

(a 2 l + b 2 l) (“22 + b 22 ) 1 • • (“2 n + b 2 n) 

. (a m l + bmi) (“m2 + bm2) ' ' ' (“»» + k “) - 


A + B = (ay + by)mxn 

Note that two matrices can be added only if they are of the same order. 

2. Multiplication of a Matrix by a Scalar 

We define the multiplication of a matrix A by a scalar c as 


cA = c 


an 

<*12 

<*ln 


* can 

cai2 

cain 

<*21 

<*22 ‘ 

<*2n 

= 

ca2i 

ca22 

Cfl2n 

.<*ml 

<*m2 

• • <*mn _ 


. ca m i 

C<*m2 

* ‘ C&mn 


3. Matrix Multiplication 

We define the product 


AB = C 


in which c- the element of C in the ith row and jth column, is found by adding 
the products of the elements of A in the ith row with the corresponding elements 
of B in the jth column. Thus, 

cy = Oil by + a i2 b2j + b a inKj 

= X>b fcj ^ 

fc = l 

This result is shown below. 


O-il a i2 ’ ‘ ‘ a in ^ 


A(mxn) 


B(nxp) 


C(mxp) 
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Note carefully that the number of columns of A must be equal to the number of 
rows of B if this procedure is to work. In other words, AB, the product of matrices 
A and B, is defined only if the number of columns of A is equal to the number of 
rows of B. If this condition is not satisfied, the product AB is not defined and is 
meaningless. When the number of columns of A is equal to the number of rows of 
B, matrix A is said to be conformable to matrix B for the product AB. Observe 
that if A is an m x n matrix and B is an n x p matrix, A and B are conformable 
for the product, and C is an m x p matrix. 

We demonstrate the use of the rule in Eq. (B.56) with the following examples. 

[2 31 (-8 9 5 7- 

[1 3 1 2] 

1 1 = 3 4 2 3 

|_2 1 1 lj 

3 lj 1.5 10 4 7 J 


[2 1 3] 1 


In both cases above, the two matrices are conformable. However, if we interchange 
the order of the matrices as follows, 


13 12 

2 111 


the matrices are no longer conformable for the product. It is evident that in general, 

AB / BA 

Indeed, AB may exist and BA may not exist, or vice versa, as in the above exam- 
ples. We shall see later that for some special matrices, 


AB = BA (B.57) 

When Eq. (B.57) is true, matrices A and B are said to commute. We must stress 
here again that in general, matrices do not commute. Operation (B.57) is valid only 
for some special cases. 

In the matrix product AB, matrix A is said to be postmultiplied by B or 
matrix B is said to be premultiplied by A. We may also verify the following 
relationships: 

(A + B)C = AC + BC (B.58) 

C(A + B) = CA + CB (B.59) 


We can verify that any matrix A premultiplied or postmultiplied by the identity 
matrix I remains unchanged: 
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AI = I A = A (B.60) 

Of course, we must make sure that the order of I is such that the matrices are 
conformable for the corresponding product. 

4. Multiplication of a Matrix by a Vector 

Consider the matrix Eq. (B.52), which represents Eq. (B.48). The right-hand 
side of Eq. (B.52) is a product of the m x n matrix A and a vector x. If, for the 
time being, we treat the vector x as if it were an n x 1 matrix, then the product 
Ax, according to the matrix multiplication rule, yields the right-hand side of Eq. 
(B.48). Thus, we may multiply a matrix by a vector by treating the vector as if it 
were an n x 1 matrix. Note that the constraint of conformability still applies. Thus, 
in this case, xA is not defined and is meaningless. 


5. Matrix Inversion 

To define the inverse of a matrix, let us consider the set of equations 
yi Q>\\ &12 • ■ * flln 

j/2 a 2 i a 22 • • • a 2 „ x 2 _ ^ 


L Vn J L a nl a n2 a nn J L^nJ 

We can solve this set of equations for xi, x 2 , .... x„ in terms of j/i, 2 / 2 . • • • > Vn by 
using Cramer’s rule [see Eq. (B.31)]. This yields 



in which |A| is the determinant of the matrix A and |Dy| is the cofactor of element 
aij in the matrix A. The cofactor of element ay is given by (-1) ,+J times the 
determinant of the (n - 1) x (n - 1) matrix that is obtained when the ith row and 
the jth column in matrix A are deleted. 

We can express Eq. (B.61) in matrix form as 


y = Ax 


(B.63) 


We can now define A -1 , the inverse of a square matrix A, with the property 


A _1 A = I (unit matrix) (B.64) 

Then, premultiplying both sides of Eq. (B.63) by A -1 , we obtain 


A -1 y = A l Ax = lx = x 
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or 

x = A~ l y (B.65) 

A comparison of Eq. (B.65) with Eq. (B.62) shows that 

|D„| |D 21 | |D nl | 

|D 12 | |D 22 | |D n2 | 


^lnl |0 2n | ' ' |U nn j 

One of the conditions necessary for a unique solution of Eq. (B.61) is that the 
number of equations must equal the number of unknowns. This implies that the 
matrix A must be a square matrix. In addition, we observe from the solution as 
given in Eq. (B.62) that if the solution is to exist, |A| ^ O.f Therefore, the inverse 
exists only for a square matrix and only under the condition that the determinant 
of the matrix be nonzero. A matrix whose determinant is nonzero is a nonsin- 
gular matrix. Thus, an inverse exists only for a nonsingular (square) matrix. By 
definition, we have 

A -1 A = I (B.67a) 

Postmultiplying this equation by A -1 and then premultiplying by A, we can show 
that 

AA’ 1 = I (B.67b) 

Note that the matrices A and A -1 commute. 





|D 3 i| = 1, |D 32 | = -5, |D 33 | = 3 

and |A| = —4. Therefore, 



f These two conditions imply that the number of equations is equal to the number of unknowns 
and that all the equations are independent. 


I 



(B.71c) 
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The proofs of identities (B.71a) and (B.71b) are trivial. We can prove Eq. (B.71c) 
as follows. Let A be an m x n matrix and B an n x p matrix. Then, if 


from Eq. (B.56), we have 


C = AB 


Cik — 'y ] a ijbjk 
i - 1 

n n 

Cik = ^ &ijbjk + yi a ijbjk 
j- 1 i-i 


Cjj — dij ”f* &ik 


Equation (B.72) along with the multiplication rule clearly indicate that d ik is the 
ifcth element of matrix AB and e lk is the ikth element of matrix AB. Equation 
(B.71c) then follows. 

If we let B = A -1 in Eq. (B.71c), we obtain 


But since 


we have 


1(aa- 1 ) = ~a- 1 + a^a- 1 

dt dt dt 


— (AA -1 ) = -j-I = 0 
dt dt 


— (A -1 ) = -A-^A" 1 
dV dt 


B.6-4 The Characteristic Equation of a Matrix: The Cayley-Hamilton 
Theorem 

For an (n x n) square matrix A, any vector x (x ^ 0) that satisfies the equation 

Ax = Ax (B.74) 

is an eigenvector (or characteristic vector), and A is the corresponding eigen- 
value (or characteristic value) of A. Equation (B.74) can be expressed as 

(A - AI)x = 0 (B.75) 

The solution for this set of homogeneous equations exists if and only if 


|A — AI| = |AI — A| = 0 


(B.76a) 


or 
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an — A ai 2 ■ • • a i n 

a 21 0,22 A a 2n =o (B .76b) 


I a nl a n2 ' ’ ' a nn * I 

Equation (B.76a) [or (B.76b)] is known as the characteristic equation of the 
matrix A and can be expressed as 

Q( A) = |AI - A| = A n + a n _iA n_1 + • • • + oiA + a 0 A° = 0 (B.77) 

<o(a) is called the characteristic polynomial of the matrix A. The n zeros of 
the characteristic polynomial are the eigenvalues of A and, corresponding to each 
eigenvalue, there is an eigenvector that satisfies Eq. (B.74). 

The Cayley-Hamilton theorem states that every n x n matrix A satisfies 
its own characteristic equation. In other words, Eq. (B.77) is valid if A is replaced 
by A: 

Q(A) = A” + a n _iA n_1 + • • • + oi A 4- o 0 A° = 0 (B.78) 


Functions of a Matrix 

The Cayley-Hamilton theorem can be used to evaluate functions of a square 
matrix A, as shown below. 

Consider a function /(A) in the form of an infinite power series. 


OO 

/(A) = a 0 + + a 2 A 2 + ^ «<** (B-79) 

i=0 

Because A satisfies the characteristic Eq. (B.77), we can write 

A" = — a n _iA n_l - a n _ 2 A n-2 aiA - a 0 (B.80) 


If we multiply both sides by A, the left-hand side is A"+\ and the right-hand side 
contains the terms A n , A n ~ l , . . . , A. Using Eq. (B.80), if we substitute A in terms 
of A"" 1 , A n “ 2 , . . . , A, the highest power on the right-hand side is reduced jo n 
Continuing in’ this way, we see that A"+ fc can be expressed in terms of A"" , A . 

. . . , A for any k. Hence, the infinite series on the right-hand side of Eq. (B.79) can 
always be expressed in terms of A n A n 2 , . . . , A as 

/(A) = /3o + Pi* + 02* 2 + ■ ■ • + Pn-\* n ~ l ( B - 81 ) 

If we assume that there are n distinct eigenvalues Aj, A 2 , . . ■ , A n , then Eq (B.81) 
holds for these n values of A. The substitution of these values in Eq. (B.81) yields 
n simultaneous equations 
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■/(Ax)] [1 Ai A? 


,1 A n A„ 


(B.82a) 


'1 Ax A 2 ••• A" 
1 A 2 A 2 • • • A 2 


(B.82b) 


L^n-xJ Ll An A 2 ••• Ar 1 ] L/(A»)J 

Since A also satisfies Eq. (B.80), we may advance a similar argument to show that 
if /(A) is a function of a square matrix A expressed as an infinite power series in 
A, then 


/(A) = aol + «iA + a 2 A 2 H 1 y>A» 


(B.83a) 


/(A) = j9 0 I + /3xA + /3 2 A 2 + ■ • • + /3„-iA" 


(B.83b) 


in which the coefficients As are found from Eq. (B.82b). If some of the eigenvalues 
are repeated (multiple roots), the results are somewhat modified. 

We shall demonstrate the utility of this result with the following two examples. 

B.6-5 Computation of an Exponential and a Power of a Matrix 

Let us compute e At defined by 

4 A 2 t 2 A n t n 

e At = I + At + — + ■■■ + — + ' " 

2s k\ 

k=0 


From Eq. (B.83b), we can express 


! = £ft(A )‘ 


in which the As are given by Eq. (B.82b), with /(Ai) - < 


B.6 Vectors and Matrices 


45 


B Example B.13 

Let us consider the case where 



The eigenvalues are 


i AI _A|= A = A 2 + 3A + 2 = (A + l)(A + 2) - 0 

2 A + 3 

Hence, Ai = —1, Ax = —2, and 

e At = 0ol + A A 


in which 




Computation of A k 


As Eq. (B.83b) indicates, we can express A k as 

A k = Aol -F 0i A + • • ■ + 0n-\ A n_1 

in which the As are given by Eq. (B.82b) with /(Ai) = A? For a completed examph 
of the computation of A k by this method, see Example 13.12. 
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B.7 Miscellaneous 

B.7-1 L’Hopital's Rule 

If lim f(x)/g{x) results in the indeterministic form 0/0 or oo/oo, then 

.. /(*) /(*) 

hm = inn 
g(x) g(x) 

B.7-2 The Taylor and Maclaurin Series 

/(*) = /(0) + 5/(0) + |j-/(0) + --- 

B.7-3 Power Series 

X 2 X 3 X n 

e- = l + x + ^ + ¥ + -"+^ + -" 


sinx=z--j, + gj--fl- + - 


X X * * 

cos X = 1 - -y + -ft - + 8! 

X 3 lx 5 17l 7 2 ^ _2 !A 

tan T — 3* 4- -j- -f- + ‘ ‘ < 7T /4 

tan x - x + 3 + 15 -r gl5 

x 3 2x 5 17x 7 2 . ,2 /4 

tanhx = x-y + — --315- + "- < > 


(1 + x)" = 1 + m + 


n(n - 1) 2 , n(n - l)(n - 2) 3 


*‘ + - + u r + - +x 


1 + rti |*| < 1 


= l + x+x 2 + x 3 + - 


B.7-4 Sums 

k r k+1 - 1 

V r m = r * 1 

' r — 1 

m=0 


W r N+l_ r M 


2-/ \b/ 6 fc (a - 6) 

m=0 
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B.7-5 Complex Numbers 


\ — 1 n odd 
e ±i B = cos 0 ± j sin 0 
a + jb = re jB r = \/a 2 + fe2 ’ 
(re j9 ) fc = rV" 

(r 1 e^)(r 2 e^) = r 1 r 2 e^ <) ‘ +93) 

B.7-6 Trigonometric Identities 


: cos x dt j sin x 


cos x = \\e? x + e ^ X ] 


sinx = £[e JI -e- jl l 
cos (x ± f ) = T sin x 
sin (x ± f) = ±cos x 
2 sin x cos x = sin 2x 
sin 2 x + cos 2 x = 1 
cos 2 x - sin 2 x = cos 2x 
cos 2 x = |(1 + cos 2x) 
sin 2 x = |(1 - cos 2x) 
cos 3 x = i(3cos x + cos 3x) 
sin 3 x = j(3sin x - sin 3x) 
sin (x ± y) = sin x cos y ± cos x sin y 
cos (x±y) = cos x cos y ^ sin x sin y 
tan x ± tan y 

2. /_ J '» — 


tan (x ± y) = 


1 :f tan x tan y 


sin x sin y = |[cos (x — y) — cos (x + y)] 
cos x cos y ~ | [cos (x — y) 4~ cos (x + y)] 
sin x cos y — 2 [sin ( x ~ v) s ^ n ' x ^ ^ - 
a cos x + !> sin x = C cos (x 4- 0) 

in which C = Va 2 + f> 2 and 9 = tan_1 
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B.7-7 Indefinite Integrals 


J u dv = uv — J v du 
J f(x)g{x)dx = f(x)g(x) - J f(x)g(x) dx 
/ sin axdx = -\ cosax / cos ax 


cos ax dx = — sin ax 
a 


/ 2 x sin 2ax f 

sin axdx = - — J 


2 x sin 2ax 

cos'* axdx = — + — 

2 4a 


f x sin ax dx = -4-(sin ax - ax cos ax) 

J a 

J x cos ax dx = — (cos ax + ax sin ax) 

/ I 2 2 

x ^ sin ax dx — — r (2ax sin ax + 2 cos ax — a x cos ax 

a 3 

/ I . 2 2* 

x ^ cos ax dx = — j(2 ax cos ax — 2 sin ax + a x sin ax 

f sin (a - b)x sin (a + b)x ^ u k2 

J sin ax sin bx dx = 2{a _ T) 2(a + t) * 

/ cos (a — b)x cos (a + b)x 2 

sin ai cos bxdx = - 2(a _ jj- + 2( a + 6) 

/■ sin (a - 6)1 sin (a + 6)1 

j cos ax cos bxdx = 2(o _j— + 2(a + 6 — 

Je ax dx = 

/* e a:E 
/ xe ax dx = —(ax - 1) 

/ »ox 
x 2 e ax dx = —j-{a 2 x 2 — 2 ax + 2) 

e ax sin hx dx = — r^(asin hx - 6 cos hi) 

a* + 6* 

/ e ax 

e ax cos bx dx = pj(acos bx + hsin hi) 

f 1 1 _,i 

/ ^ dx = - tan - 

J x 2 H- a 2 a a 

J ^^ dx = \ Hx2+a2) 


sin (a - h)i sin (a + b)i 
cos ox cos hi dx = 2(a _ j— + 2(a + 6 ) 


e ox dx = -e ax 




— — , dx = ~- in(x 2 + a 2 ) 
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B.7-8 Differentiation Table 


4 -/(“) 

dx 

d du 

= 

— = h(lna)a 6x 
dx 

d t i 
— (uu) 

dx 

dv du 

= u Tx +v Tx 

d . 

— sm ax = a cos ax 
dx 

d /u\ 
dx \v J 

1 ~ v 2 

d 

— cos ax = — a sin ax 
dx 

dx n _ 

71 — 1 

d a 

dx 

rix 

"" Lull (XX rt 

dx cos 2 ax 



d , . _i \ 

— (sin ax) = 
dx 



d . , , loge 

— log(ax) = — 


— -(cos 1 ax) 
dx 




= be tx 


— (tan x ax) 
dx 


a 

1 + a 2 x 2 


B.7-9 Some Useful Constants 

n « 3.1415926535 
e w 2.7182818284 
i ss 0.3678794411 

e 

log 10 2 = 0.30103 
log 10 3 = 0.47712 

B.7-10 Solution of Quadratic and Cubic Equations 

Any quadratic equation can be reduced to the form 

ax 2 + bx + c = 0 

The solution of this equation is provided by 

-h ± \/b 2 — 4ac 


x = 


2a 
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A general cubic equation 

y 3 + py 2 + qy + r = 0 

may be reduced to the depressed cubic form 

x 3 + ax + 6 = 0 

by substituting 

V = x ~ § 

This yields 

a=i(3g-p 2 ) f>= ±{2p 3 -9pq + 27r) 

Now let 

A = 

The solution of the depressed cubic is 

x = A + B, x = -A±b + ^b^Z 3, x = -4±B-4 f S V ^3 

and 
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Introduction to Signals 
and Systems 


In this chapter we shall discuss certain basic aspects of signals. We shall also 
introduce important basic concepts and qualitative explanations of the how’s and 
why’s of systems theory, thus building a solid foundation for understanding the 
quantitative analysis in the remainder of the book. 

Signals 

A signal, as the term implies, is a set of information or data. Examples include 
a telephone or a television signal, monthly sales of a corporation, or the daily closing 
prices of a stock market (e.g., the Dow Jones averages). In all these examples, the 
signals are functions of the independent variable time. This is not always the case, 
however. When an electrical charge is distributed over a body, for instance, the 
signal is the charge density, a function of space rather than time. In this book 
we deal almost exclusively with signals that are functions of time. The discussion, 
however, applies equally well to other independent variables. 

Systems 

Signals may be processed further by systems, which may modify them oi 
extract additional information from them. For example, an antiaircraft gun operatoi 
may want to know the future location of a hostile moving target that is being trackec 
by his radar. Knowing the radar signal he knows the past location and velocity o 
the target. By properly processing the radar signal (the input) he can approximate^ 
estimate the future location of the target. Thus, a system is an entity that processe: 
a set of signals (inputs) to yield another set of signals (outputs). A system may b< 
made up of physical components, as in electrical, mechanical, or hydraulic system: 
(hardware realization), or it may be an algorithm that computes an output fron 
an input signal (software realization) . 
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1 Introduction to Signals and Systems 


1.1 Size of a Signal 

The size of any entity is a number that indicates the largeness or strength of 
that entity. Generally speaking, the signal amplitude varies with time. How can a 
signal that exists over a certain time interval with varying amplitude be measured 
by one number that will indicate the signal size or signal strength? Such a measure 
must consider not only the signal amplitude, but also its duration. For instance, if 
we are to devise a single number V as a measure of the size of a human being, we 
must consider not only his or her width (girth), but also the height. If we make a 
simplifying assumption that the shape of a person is a cylinder of variable radius r 
(which varies with the height h) then a reasonable measure of the size of a person 
of height H is the person’s volume V , given by 


[« 

= n / r 1 2 (h) < 

JO 


Signal Energy 

Arguing in this manner, we may consider the area under a signal /(t) as a 
possible measure of its size, because it takes account of not only the amplitude, but 
also the duration. However, this will be a defective measure because f(t) could be 
a large signal, yet its positive and negative areas could cancel each other, indicating 
a signal of small size. This difficulty can be corrected by defining the signal size 
as the area under / 2 (f), which is always positive. We call this measure the signal 
energy £’/, defined (for a real signal) as 


/ OO 

f 2 (t)dt 

-OO 


This definition can be generalized to a complex valued signal f(t) as 


/ OO 

l/tol 2 

-OO 


There are also other possible measures of signal size, such as the area under |/(t)|. 
The energy measure, however, is not only more tractable mathematically, but is 
also more meaningful (as shown later) in the sense that it is indicative of the energy 
that can be extracted from the signal. 

Signal Power 

The signal energy must be finite for it to be a meaningful measure of the signal 
size. A necessary condition for the energy to be finite is that the signal amplitude 
— ► 0 as |t| — * oo (Fig. 1.1a). Otherwise the integral in Eq. (1.1) will not converge. 

In some cases, for instance, when the amplitude of /(f) does not — * 0 as |t| — > oo 
(Fig. 1.1b), then, the signal energy is infinite. A more meaningful measure of the 
signal size in such a case would be the time average of the energy, if it exists. This 
measure is called the power of the signal. For a signal /(f), we define its power Pf 


1 f T 

Pr = lim — / 

1 T-.00 T J_f 


f 2 (t) dt 
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Fig. 1.1 Examples of Signals: (a) a signal with finite energy (b) a signal with finite 
power. 


We can generalize this definition for a complex signal / (t) as 

l r T / 2 

P f = Jim i / \f(t)\ 2 dt (1.4) 

T-> oo 1 J-T/2 

Observe that the signal power Pf is the time average (mean) of the signal amplitude 
squared, that is, the mean-squared value of f(t). Indeed, the square root of Pf is 
the familiar rms (root mean square) value of /(t). 

The mean of an entity averaged over a large time interval approaching infinity 
exists if the entity is either periodic or has a statistical regularity. If such a condition 
is not satisfied, the average may not exist. For instance, a ramp signal /(f) = f 
increases indefinitely as jt| — > oo, and neither the energy nor the power exists for 
this signal. 

Comments 

The signal energy as defined in Eq. (1-1) or Eq. (1.2) does not indicate the 
actual energy of the signal because the signal energy depends not only on the signal, 
but also on the load. It can, however, be interpreted as the energy dissipated in a 
normalized load of a 1-ohm resistor if a voltage f{t) were to be applied across the 
1-ohm resistor (or if a current f(t) were to be passed through the 1-ohm resistor). 
The measure of “energy” is, therefore indicative of the energy capability of the 
signal and not the actual energy. For this reason the concepts of conservation oi 
energy should not be applied to this “signal energy”. Parallel observation applies 
to “signal power” defined in Eq. (1.3) or (1.4). These measures are but convenient 
indicators of the signal size, which prove useful in many applications. For instance, ii 
we approximate a signal f(t) by another signal g(t), the error in the approximation 
is e(t) = /(t) - g{t). The energy (or power) of e{t) is a convenient indicator oi 
the goodness of the approximation. It provides us with a quantitative measure oi 
determining the closeness of the approximation. In communication systems, during 
transmission over a channel, message signals are corrupted by unwanted signals 
(noise). The quality of the received signal is judged by the relative sizes of the 
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Fig. 1.2 Signals for Example 1.1. 


desired signal and the unwanted signal (noise). In this case the ratio of the message 
signal and noise signal powers (signal to noise power ratio) is a good indication of 
the received signal quality. 

Units of Energy and Power: Equations (1.1) and (1.2) are not correct dimen- 
sionally. This is because here we are using the term energy not in its conventional 
sense, but to indicate the signal size. The same observation applies to Eqs. (1.3) 
and (1.4) for power. The units of energy and power, as defined here, depend on 
the nature of the signal f(t). If f(t) is a voltage signal, its energy E f has units of 
y 2 s (volts squared-seconds) and its power P j has units of V 2 (volts squared). If 
f(t) is a current signal, these units will be A 2 s (amperes squared-seconds) and A 2 
(amperes squared), respectively. 

I Example 1.1 

Determine the suitable measures of the signals in Fig 1.2. 

In Fig. 1.2a, the signal amplitude -» 0 as |t| -* oo. Therefore the suitable measure 
for this signal is its energy Ef given by 

/ OO /’O roo 

/ 2 (t) dt = / (2) 2 dt + / 4e -t dt = 4 + 4 = 8 

oo J - 1 J o 

In Fig. 1.2b, the signal amplitude does not — »■ 0 as |t| — ► oo. However, it is periodic, and 
therefore its power exists. We can use Eq. (1.3) to determine its power. We can simplify 
the procedure for periodic signals by observing that a periodic signal repeats regularly 
each period (2 seconds in this case). Therefore, averaging f 2 (t) over an infinitely large 
interval is identical to averaging this quantity over one period (2 seconds in this case). 
Thus 



Recall that the signal power is the square of its rms value. Therefore, the rms value of 
this signal is l/\/3. B 
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■ Example 1.2 

Determine the power and the rms value of 

(a) f(t) = C cos (iv 0 t + 0) (b) /(t) = Ci cos (wit + 8i) + C 2 cos(w 2 t + 02) (wi #w 2 ). 
(c) f(t) = De ju>ot . 

(a) This is a periodic signal with period To = 27r/wo. The suitable measure of this 
signal is its power. Because it is a periodic signal, we may compute its power by averaging 
its energy over one period T 0 = 2x/u 0 . However, for the sake of demonstration, we shall 
solve this problem by averaging over an infinitely large time interval using Eq (1.3). 

/ T /2 /-»2 Z '^’/ 2 

C 2 cos 2 (w 0 t + 8)dt= lim — / [1 + cos (2 wot + 28)} dt 

- t /2 t ^°° J-T/t 

si2 rT/2 si2 rT/2 

= lim — / dt+ lim — / cos (2w 0 t + 28) dt 
T— OO 2T J _ T /2 T— oo 2 T J _ T /2 

The first term on the right-hand side is equal to C 2 / 2. Moreover, the second term is zero 
because the integral appearing in this term represents the area under a sinusoid over a 
very large time interval T with T -> oo . This area is at most equal to the area of halt the 
cycle because of cancellations of the positive and negative areas of a sinusoid. The second 
term is this area multiplied by C 2 /2T with T - oo. Clearly this term is zero, and 

Pf = Y ( 15a ) 

This shows that a sinusoid of amplitude C has a power C 2 / 2 regardless of the value of its 
frequency wo (wo 5 * 0) and phase 8. The rms value is C/V2. If the signal frequency is zero 
(dc or a constant signal of amplitude C), the reader can show that the power is C . 

(b) In Chapter 4, we show that a sum of two sinusoids may or may not be periodic, 
depending on whether the ratio wi/o> 2 is a rational number or not. Therefore, the period 
of this signal is not known. Hence, its power will be determined by averaging its energy 
over T seconds with T —> oo. Thus, 



The first and second integrals on the right-hand side are the powers of the two sinusoids, 
which are Ci 2 /2 and C 2 2 / 2 as found in part (a). Arguing as in part (a), we see that the 
third term is zero, and we havef 


Pf = £il + (i.5b) 

1 2 2 

and the rms value is \J (C i 2 + C 2 2 )/2. 

We can readily extend this result to a sum of any number of sinusoids with distinct 
frequencies. Thus, if 


tThis is true only if w a * w 2 . If u>i = w 2 , the integrand of the third term contains a constant 
cos (8i - 0 2 ), and the third term — > 2 CiC 2 cos [ 8 1 - fl 2 ) as T — > oo. 
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f(t) = C n cos (w„t + 8 n ) 

71 = 1 

where none of the two sinusoids have identical frequencies, then 

p f = \'E c ’' 2 (1 - 5c) 

n=l 

(c) In this case the signal is complex, and we use Eq. (1.4) to compute the power. 

i r T/ 2 

P^liml/ \De^fdt 

T— oo J J _ T/2 

Recall that |e J '“°‘| = 1 so that |De iu °‘| 2 = |D| 2 , and 


P f = \D \ 2 ( 15d ) 

The rms value is \D\. B 

Comment: In part (b) we have shown that the power of the sum of two sinusoids 
is equal to the sum of the powers of the sinusoids. It appears that the power of 
fi{t) + / 2 (f) is P/, + P/ 2 . Unfortunately, this conclusion is not true in general. It 
is true only under a certain condition (orthogonality) discussed later in Sec. 3.1-3. 

A Exercise El.X 

Show that the energies of the signals in Figs. 1.3a, b,c and d are 4, 1, 4/3, and 4/3, respec- 
tively. Observe that doubling a signal quadruples the energy, and time-shifting a signal has no 
effect on the energy. Show also that the power of the signal in Fig. 1.3e is 0.4323. What is the 
rms value of signal in Fig. 1.3e? V 
A Exercise El. 2 

Redo Example 1.2a to find the power of a sinusoid C cos (wot + 9) by averaging the signal 
energy over one period T 0 = 2*/w 0 (rather than averaging over the infinitely large interval). Show 
also that the power of a constant signal /(t) = Co is Cq, and its rms value is Co- V 

A Exercise El. 3 2 

Show that if wi = W 2 , the power of f(t) = Ci cos (wit + Si) + C 2 cos (W 2 1 + 82 ) is [Ci + 
C 2 2 + 2 C 1 C 2 cos (Si - S2)]/2, which is not equal to (Ci 2 + C2 2 )/2. V 



(b) 

Fig. 1.4 Continuous-time and Discrete-time Signals. 


1.2 Classification of Signals 

There are several classes of signals. Here we shall consider only the following 
classes, which are suitable for the scope of this book: 

1. Continuous-time and discrete- time signals 

2. Analog and digital signals 

3. Periodic and aperiodic signals 

4. Energy and power signals 

5. Deterministic and probabilistic signals 

1.2-1 Continuous-Time and Discrete-Time Signals 

A signal that is specified for every value of time t (Fig. 1.4a) is a continuous- 
time signal, and a signal that is specified only at discrete values of t (Fig. 1.4b) is 
a discrete-time signal. Telephone and video camera outputs are continuous-time 
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Fig. 1.5 Examples of Signals: (a) analog, continuous-time (b) digital, continuous-time 
(c) analog, discrete-time (d) digital, discrete-time. 


signals, whereas the quarterly gross national product (GNP), monthly sales of a 
corporation, and stock market daily averages are discrete-time signals. 

1.2- 2 Analog and Digital Signals 

The concept of continuous-time is often confused with that of analog. The two 
are not the same. The same is true of the concepts of discrete-time and digital. A 
signal whose amplitude can take on any value in a continuous range is an analog 
signal. This means that an analog signal amplitude can take on an infinite number 
of values. A digital signal, on the other hand, is one whose amplitude can take 
on only a finite number of values. Signals associated with a digital computer are 
digital because they take on only two values (binary signals). A digital signal whose 
amplitudes can take on M values is an M-ary signal of which binary (M = 2) is 
a special case. The terms continuous-time and discrete-time qualify the nature of 
a signal along the time (horizontal) axis. The terms analog and digital , on the 
other hand, qualify the nature of the signal amplitude (vertical axis). Figure 1.5 
shows examples of various types of signals. It is clear that analog is not necessarily 
continuous-time and digital need not be discrete-time. Figure 1.5c shows an example 
of an analog discrete-time signal. An analog signal can be converted into a digital 
signal [analog-to-digital (A/D) conversion] through quantization (rounding off), as 
explained in Sec. 5.1-3. 

1.2- 3 Periodic and Aperiodic Signals 

A signal f(t) is said to be periodic if for some positive constant To 


/(f) = /(t + T 0 ) 


for all t 


(1.6) 
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Fig. 1.6 A periodic signal of period To- 


The smallest value of T 0 that satisfies the periodicity condition (1.6) is the period 
of fit). The signals in Figs. 1.2b and 1.3e are periodic signals with periods 2 and 1, 
respectively. A signal is aperiodic if it is not periodic. Signals in Figs. 1.2a, 1.3a, 
1.3b, 1.3c, and 1.3d are all aperiodic. 

By definition, a periodic signal f{t) remains unchanged when time-shifted by 
one period. For this reason a periodic signal must start at t - -oo because if it 
starts at some finite instant, say t = 0, the time-shifted signal f(t + T 0 ) will start at 
t = -T 0 and f{t + T 0 ) would not be the same as /(f). Therefore a periodic signal, 
by definition, must start at t = -oo and continuing forever, as illustrated in Fig. 

1 6 

Another important property of a periodic signal /(t) is that f(t) can be gen- 
erated by periodic extension of any segment of /(f) of duration T 0 (the period). 
As a result we can generate f(t) from any segment of /(f) with a duration of one 
period by placing this segment and the reproduction thereof end to end ad 
turn on either side. Figure 1.7 shows a periodic signal /(f) of period T 0 - 6. The 
shaded portion of Fig. 1.7a shows a segment of /(f) starting at t - -1 and haying 
a duration of one period (6 seconds). This segment, when repeated forever in either 
direction, results in the periodic signal /(f). Figure 1.7b shows another shade 
segment of /(f) of duration T 0 starting at f = 0. Again we see that this segment, 
when repeated forever on either side, results in /(f). The reader can verify that this 
construction is possible with any segment of /(f) starting at any instant as long as 
the segment duration is one period. 

It is helpful to label signals that start at f = -oo and continue for ever as 
everlasting signals. Thus, an everlasting signal exists over the entire interval -oo < 
t < oo. The signals in Figs. 1.1b and 1.2b axe examples of everlasting signals. 
Clearly, a periodic signal, by definition, is an everlasting signal. 

A signal that does not start before f = 0 is a causal signal. In other words, 
/(t) is a causal signal if 

/(f) = 0 t < 0 ( 1J ) 

Signals in Figs. 1.3a, b, c, as well as in Figs. 1.9a and 1.9b are causal signals. A 
signal that starts before f = 0 is a noncausal signal. All the signals in Figs 1. 
and 1.2 are noncausal. Observe that an everlasting signal is always noncausal but 
a noncausal signal is not necessarily everlasting. The everlasting signal in Fig. 1.2 b 
is noncausal; however, the noncausal signal in Fig. 1.2a is not everlasting. A signa 
that is zero for all f > 0 is called an anticausal signal. 
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Fig. 1.7 Generation of a periodic signal by periodic extension of its segment of one-period 
duration. 

Comment: 

A true everlasting signal cannot be generated in practice for obvious reasons. 
Why should we bother to postulate such a signal? In later chapters we shall see 
that certain signals (including an everlasting sinusoid) which cannot be generated 
in practice do serve a very useful purpose in the study of signals and systems. 

1.2- 4 Energy and Power Signals 

A signal with finite energy is an energy signal, and a signal with finite and 
nonzero power is a power signal. Signals in Fig. 1. 2a and 1.2b are examples of 
energy and power signals, respectively. Observe that power is the time average of 
energy. Since the averaging is over an infinitely large interval, a signal with finite 
energy has zero power, and a signal with finite power has infinite energy. Therefore, 
a signal cannot both be an energy and a power signal. If it is one, it cannot be 
the other. On the other hand, there are signals that are neither energy nor power 
signals. The ramp signal is such an example. 

Comments 

All practical signals have finite energies and are therefore energy signals. A 
power signal must necessarily have infinite duration; otherwise its power, which is 
its energy averaged over an infinitely large interval, will not approach a (nonzero) 
limit. Clearly, it is impossible to generate a true power signal in practice because 
such a signal has infinite duration and infinite energy. 

Also, because of periodic repetition, periodic signals for which the area under 
|/(t)| 2 over one period is finite are power signals; however, not all power signals are 
periodic. 

A Exercise El .4 

Show that an everlasting exponential e -ot is neither an energy nor a power signal for any 
real value of a. However, if o is imaginary, it is a power signal with power Pj = 1 regardless of 
the value of a. V 

1.2- 5 Deterministic and Random Signals 

A signal whose physical description is known completely, either in a mathemat- 
ical form or a graphical form, is a deterministic signal. A signal whose values 
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Fig. 1.8 Time shifting a signal. 


cannot be predicted precisely but are known only in terms of probabilistic descrip- 
tion, such as mean value, mean squared value, and so on is a random signal. In 
this book we shall exclusively deal with deterministic signals. Random signals are 
beyond the scope of this study. 

1.3 Some Useful Signal Operations 

We discuss here three useful signal operations: shifting, scaling, and inversion. 
Since the independent variable in our signal description is time, these operations are 
discussed as time shifting, time scaling, and time inversion (or folding). However, 
this discussion is valid for functions having independent variables other than time 
(e.g., frequency or distance). 

1.3-1 Time Shifting 

Consider a signal /(f) (Fig. 1.8a) and the same signal delayed by T seconds 
(Fig. 1.8b), which we shall denote by Whatever happens in /(f) (Fig. 1.8a) at 
some instant f also happens in 0(f) (Fig. 1.8b) T seconds later at the instant t + T. 
Therefore 

<t>(t + T) = f(t) (1-8) 

and 

4>(t) = f(t - T) (1.9) 

Therefore, to time-shift a signal by T, we replace f with t-T. Thus f(t - T) 
represents /(f) time-shifted by T seconds. If T is positive, the shift is to the right 
(delay). If T is negative, the shift is to the left (advance). Thus, f(t - 2) is /(f) 
delayed (right-shifted) by 2 seconds, and /(f 4- 2) is /(f) advanced (left-shifted) by 
2 seconds. 
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Fig. 1.9 (a) signal f(t) (b) f(t ) delayed by 1 second (c) /(t) advanced by 1 second. 


B Example 1.3 

An exponential function f(t) = e~ u shown in Fig. 1.9a is delayed by 1 second. Sketch 
and mathematically describe the delayed function. Repeat the problem if f(t) is advanced 
by 1 second. 

The function f(t) can be described mathematically as 



t > 0 
t < 0 


( 1 . 10 ) 


Let fd{t) represent the function f(t) delayed (right-shifted) by 1 second as illustrated in 
Fig. 1.9b. This function is f(t — 1); its mathematical description can be obtained from 
f(t) by replacing t with t — 1 in Eq. (1.10). Thus 


fd(t) = fit - 1) = 


g -2(t-l) 

0 


t — 1 > 0 or t > 1 
t — 1 < 0 or f<l 


( 1 . 11 ) 


Let f a {t) represent the function /(t) advanced (left-shifted) by 1 second as depicted in Fig. 
1.9c. This function is f(t + 1); its mathematical description can be obtained from /(f) by 
replacing f with t + 1 in Eq. (1.10). Thus 


fa.(t) = f(t + 1) = 


{ 


g -2(t+l) 

0 


f + 1 > 0 or t > — 1 
f + 1 < 0 or t<-l 



A Exercise El. 5 

Write a mathematical description of the signal /3ft) in Fig. 1.3c. This signal is delayed 
by 2 seconds. Sketch the delayed signal. Show that this delayed signal fd(t) can be described 
mathematically as fd(t) = 2 (t — 2) for 2 < t < 3, and equal to 0 otherwise. Now repeat the 
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Fig. 1.10 Time scaling a signal. 


procedure if the signal is advanced (left-shifted) by 1 second. Show that this advanced signal f a {t) 
can be described as / 0 (t) = 2(t + 1) for — 1 < t < 0, and equal to 0 otherwise. V 

1.3-2 Time Scaling 

The compression or expansion of a signal in time is known as time scaling. 
Consider the signal /(<) of Fig. 1.10a. The signal </>(t) in Fig. 1.10b is /(f) com- 
pressed in time by a factor of 2. Therefore, whatever happens in /(f) at some 
instant t also happens to <p(t) at the instant t/2, so that 

*(!) = /(*) ( 113 ) 

and 

m = /(*) (i.i4) 

Observe that because f(t) = 0 at t = Ti and X 2 , we must have 1 p(t) = 0 at t = Ti/2 
and T 2 / 2 , as shown in Fig. 1.10b. If /(t) were recorded on a tape and played back 
at twice the normal recording speed, we would obtain f(2t). In general, if f(t) is 
compressed in time by a factor a (a > 1), the resulting signal <f>(t) is given by 

*(t) = /(at) (1-15) 

Using a similar argument, we can show that f(t) expanded (slowed down) in 
time by a factor a (a > 1) is given by 

*« = /(£) ( 116 ) 

Figure 1.10c shows /(§), which is f(t) expanded in time by a factor of 2. Observe 
that in time scaling operation, the origin t = 0 is the anchor point, which remains 
unchanged under scaling operation because at t = 0, /(f) = f(at ) = /( 0). 

In summary, to time-scale a signal by a factor a, we replace f with at. If a > 1, 
the scaling results in compression, and if a < 1, the scaling results in expansion. 
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I Example 1.4 ........ 

Figure 1.11a shows a signal f(t). Sketch and describe mathematically this signal 
time-compressed by factor 3. Repeat the problem for the same signal time-expanded by 
factor 2. 

The signal /(t) can be described as 



-1.5 < t < 0 
0 < t < 3 
otherwise 


(1.17) 


Figure 1.11b shows / c (i), which is /(i) time-compressed by factor 3; consequently, it can 
be described mathematically as /(3t), which is obtained by replacing t with 3t in the 
right-hand side of Eq. 1.17. Thus 


( 2 —1.5 < 3t < 0 or - 0.5 < t < 0 

2 e -3t/2 0 < 3t < 3 or 0<t<l (1.18a) 

0 otherwise 

Observe that the instants t = -1.5 and 3 in f(t) correspond to the instants t = -0.5, and 

1 in the compressed signal /(3t). . . 

Figure 1.11c shows / e (t), which is }{t) time-expanded by factor 2; consequently, it 
can be described mathematically as f(tf 2), which is obtained by replacing t with tj 2 m 
fit). Thus 
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Fig. 1.12 Time inversion (reflection) of a signal. 


t 2 -1.5 < | < 0 or - 3 < t < 0 

/e(f ) = /(i)= 2e-‘^ 0 < | < 3 or 0<t<6 U-18b) 

[ 0 otherwise 

Observe that the instants t = -1.5 and 3 in /(t) correspond to the instants t = -3 and 6 
in the expanded signal /( 5). B 
A Exercise E1.6 

Show that the time-compression by a factor n (n > 1) of a sinusoid results in a sinusoid of the 
same amplitude and phase, but with the frequency increased n-fold. Similarly the time expansion 
by a factor n (n > 1) of a sinusoid results in a sinusoid of the same amplitude and phase, but with 
the frequency reduced by a factor ». Verify your conclusion by sketching a sinusoid sin 2t and the 
same sinusoid compressed by a factor 3 and expanded by a factor 2. V 

1.3-3 Time Inversion (Time Reversal) 

Consider the signal /(«) in Fig. 1.12a. We can view f{t) as a rigid wire frame 
hinged at the vertical axis. To time-invert /(<), we rotate this frame 180° about the 
vertical axis. This time inversion or folding [the reflection of f{t) about the vertical 
axis] gives us the signal *(t) (Fig. 1.12b). Observe that whatever happens m Fig. 
1.12a at some instant t also happens in Fig. 1.12b at the instant -t. Therefore 

= /(0 

and 

<A(f) = /(-<) < U9) 

Therefore, to time-invert a signal we replace t with -t. Thus, the time inversion of 
signal f{t) yields f(-t). Consequently, the mirror image of f(t) about the vertical 
axis is fi-t). Recall also that the mirror image of f(t) about the horizontal axis is 

-fit)- 
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| 1 3 5 7 ' 

Fig. 1.13 An example of time inversion. 


H Example 1.5 

For the signal f(t) illustrated in Fig. 1.13a, sketch /(— t), which is time inverted f(t). 
The instants -1 and -5 in /(f) are mapped into instants 1 and 5 in /(—*)- Because 
/(t) = e t/2 , we have /(-t) = e _t/2 . The signal /(-t) is depicted in Fig. 1.13b. We can 
describe /(t) and /(— t) as 



-1 > t > -5 
otherwise 


and its time inverted version /(— t) is obtained by replacing t with — t in /(t) as 


/(-«) 



— 1 > — t > —5 or 1 < t < 5 
otherwise 


1.3-4 Combined Operations 

Certain complex operations require simultaneous use of more than one of the 
above operations. The most general operation involving all the three operations is 
/(at - b), which is realized in two possible sequences of operation: 

1. Time-shift /(t) by b to obtain f{t-b). Now time-scale the shifted signal f(t-b) 
by a (that is, replace t with at) to obtain /(at - fe). 

2. Time-scale f(t) by a to obtain /(at). Now time-shift /(at) by | (that is, replace 
t with (t - |) to obtain /[a(t - £)] = /(at - b). In either case, if a is negative, 
time scaling involves time inversion. 

For instance, the signal /(2t - 6) can be obtained in two ways: first, delay / (t) 
by 6 to obtain /(* — 6) and then time-compress this signal by factor 2 (replace t 
with 2t) to obtain /(2t - 6). Alternately, we first time-compress /(t) by factor 2 to 
obtain /(2t), then delay this signal by 3 (replace t with t - 3) to obtain /(2t - 6). 


1.4 Some Useful Signal Models 

In the area of signals and systems, the step, the impulse, and the exponential 
functions are very useful. They not only serve as a basis for representing other 
signals, but their use can simplify many aspects of the signals and systems. 
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1. Unit Step Function u(t) 

In much of our discussion, the signals begin at f = 0 (causal signals). Such 
signals can be conveniently described in terms of unit step function u(t) shown in 
Fig. 1.14a. This function is defined by 



t > 0 
t < 0 


( 1 . 20 ) 


If we want a signal to start at f = 0 (so that it has a value of zero for t < 0), we 
only need to multiply the signal with u(f ). For instance, the signal e~ at represents an 
everlasting exponential that starts at t = -oo. The causal form of this exponential 
illustrated in Fig. 1.14b can be described as e~ at u(t). 

The unit step function also proves very useful in specifying a function with 
different mathematical descriptions over different intervals. Examples of such func- 
tions appear in Fig. 1.11. These functions have different mathematical descriptions 
over different segments of time as seen from Eqs. (1-17), (1.18a), and (1.18b). Such 
a description often proves clumsy and inconvenient in mathematical treatment. Us- 
ing the unit step function, we can describe such functions by a single expression 
that is valid for all t. 



Fig. 1.15 Representation of a rectangular pulse by step functions. 


Consider, for example, the rectangular pulse depicted in Fig. 1.15a. We can 
express such a pulse in terms of familiar step functions by observing that the pulse 
f(t) can be expressed as the sum of the two delayed unit step functions as shown 
in Fig. 1.15b. The unit step function u(f) delayed by T seconds is u(t - T). From 
Fig. 1.15b, it is clear that 


/(t) = it (t - 2) - u(t - 4) 
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Fig. 1.16 Representation of a signal defined interval by interval. 


■ Example 1.6 

Describe the signal in Fig. 1.16a. 

The signal illustrated in Fig. 1.16a can be conveniently handled by breaking it up 
into the two components /i(t) and / 3 (t), depicted in Figs. 1.16b and 1.16c respectively. 
Here, /i(t) can be obtained by multiplying the ramp t by the gate pulse u(t) u(t 2), 
as shown in Fig. 1.16b. Therefore 

/ 1 (t) = t[u(t)-u(t-2)] 

The signal / 2 (t ) can be obtained by multiplying another ramp by the gate pulse illustrated 
in Fig. 1.16c. This ramp has a slope -2; hence it can be described by -2t+c. Now, because 
the ramp has a zero value at t = 3, the constant c = 6, and the ramp can be described by 
-2(t - 3). Also, the gate pulse in Fig. 1.16c is u(t - 2) - u{t - 3). Therefore 

h(t) = —2(1 - 3) [u(t - 2) - u(t - 3)] 

aIld f(t) = h(t) + f2(t) 

= t [u(f) - u(t - 2)] - 2 (t - 3) [u{t - 2) - u{t - 3)] 

= tu{t) - 3(t - 2 )u(t - 2) + 2(1 - 3)ti(l - 3) ■ 

■ Example 1.7 

Describe the signal in Fig. 1.11a by a single expression valid for all 1. 

Over the interval from -1.5 to 0, the signal can be described by a constant 2, and 
over the interval from 0 to 3, it can be described by 2e (/ . Therefore 

f(t) = 2[u(t + 1.5) - u(l)) + 2e“ t/2 [u(l) - u{t - 3)]_ 

„ ' ' ~ 

/iM A<*> 

= 2u(l + 1.5) - 2(1 - e" t/2 )u(l) - 2 e" t/2 u(l - 3) 
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Fig. 1.18 The signal for Exercise El. 8. 


Compare this expression with the expression for the same function found in Eq. 1.17. ■ 

A Exercise El. 7 

Show that the signals depicted in Figs. 1.17a and 1.17b can be described as u(-t), and 
e - “*u(-t), respectively. V 
A Exercise E1.8 

Show that the signal shown in Fig. 1.18 can be described as 

f(t) = (t - 1 )u(t - 1) - (t - 2 )u(t - 2) - u(t - 4) V 


2. The Unit Impulse Function 6{t) 

The unit impulse function 6{t) is one of the most important functions in the 
study of signals and systems. This function was first defined by P. A. M Dirac as 

S(t) = 0 1 1 0 

r w*..! o- 21 ) 

J — OO 

We can visualize an impulse as a tall, narrow rectangular pulse of unit area 
as illustrated in Fig. 1.19b. The width of this rectangular pulse is a very small 
value e -> 0. Consequently, its height is a very large value \Jt The unit impulse 
therefore can be regarded as a rectangular pulse with a width that has become 
infinitesimally small, a height that has become infinitely large, and an overall area 
that has been maintained at unity. Thus S(t) = 0 everywhere except at t = 0, where 
it is undefined. For this reason a unit impulse is represented by the spear-like symbo 

in F'is 1 1 9 r 

Other pulses, such as exponential pulse, triangular pulse, or Gaussian pulse 
may also be used in impulse approximation. The important feature of the uni 
impulse function is not its shape but the fact that its effective duration (pulse width) 
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(a) (b) 

Fig. 1.20 Other possible approximations to a unit impulse. 


approaches zero while its area remains at unity. For example, the exponential pulse 
ae~ at u(t) in Fig. 1.20a becomes taller and narrower as a increases. In the limit as 
a 00) the pulse height — * oo, and its width or duration — > 0. Yet, the area under 
the pulse is unity regardless of the value of a because 

f ae~ at dt = 1 (1.22) 

Jo 

The pulses in Figs. 1.20b and 1.20c behave in a similar fashion. 

From Eq. (1.21), it follows that the function kS(t ) = 0 for all t 0, and its 
area is k. Thus, k6(t ) is an impulse function whose area is k (in contrast to the unit 
impulse function, whose area is 1). 

Multiplication of a Function by an Impulse 

Let us now consider what happens when we multiply the unit impulse 6(t) by 
a function 4>(t) that is known to be continuous at t = 0. Since the impulse exists 
only at t — 0, and the value of (j>(t) at t = 0 is <f>( 0), we obtain 

<t>{t)S(t) = <f>(0)S{t) (1.23a) 

Similarly, if <t>(t) is multiplied by an impulse 6(t - T ) (impulse located at t = T), 
then 

4>(t)6(t — T) = <f>(T)6(t - T) (1.23b) 

provided 4>(t) is continuous at t = T. 
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Sampling Property of the Unit Impulse Function 

From Eq. (1.23a) it follows that 



provided <t>(t) is continuous at t = 0. This result means that the area under the 
product of a function with an impulse S(t) is equal to the value of that function at 
the instant where the unit impulse is located. This property is very important and 
useful, and is known as the sampling or sifting property of the unit impulse. 

From Eq. (1.23b) it follows that 

r,mt-T)dt=m (i- 24b ) 

J — oo 

Equation (1.24b) is just another form of sampling or sifting property. In the case 
of Eq. (1.24b), the impulse S(t - T) is located at t = T. Therefore, the area under 
Mt)S(t - T) is 0(T), the value of 4>(t) at the instant where the impulse is located 
( at t - t). In these derivations we have assumed that the function is continuous 
at the instant where the impulse is located. 


Unit Impulse as a Generalized Function 

The definition of the unit impulse function given in Eq. (1.21) is not mathe- 
matically rigorous, which leads to serious difficulties. First the impulse function 
does not define a unique function: for example, it can be shown that 6(t) + S(t) 
also satisfies Eq. (1.21). 1 Moreover, S(t) is not even a true function m the ordinary 
sense. An ordinary function is specified by its values for all time t. The impulse 
function is zero everywhere except at t = 0, and at this only interesting part of its 
range it is undefined. These difficulties are resolved by defining the impulse as a 
generalized function rather than an ordinary function. A generalized function is 
defined by its effect on other functions instead of by its value at every instant o 

tim In this approach the impulse function is defined by the sampling property [Eq. 
(1.24)1. We say nothing about what the impulse function is or what it looks like. 
Instead, the impulse function is defined in terms of its effect on a test function 
Alt) We define a unit impulse as a function for which the area under its produc 
with a function *(t) is equal to the value of the function *(t) at the instant where 
the impulse is located. It is assumed that <t>(t) is continuous at the location of the 
impulse. Therefore, either Eq. (1.24a) or (1.24b) can serve as a definition of the 
impulse function in this approach. Recall that the sampling property [Eq. 1.24)] 
is the consequence of the classical (Dirac) definition of impulse in Eq. (1.21). In 
contrast, the sampling property [Eq. (1.24)] defines the impulse function m the 

generalized function approach. j-.c-.i+irm 

We now present an interesting application of the generalized function definition 

of an impulse. Because the unit step function u(t) is discontinuous at t 0 its 
derivative du/dt does not exist at t = 0 in the ordinary sense. We now show that 
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this derivative does exist in the generalized sense, and it is, in fact, 8{t). As a proof, 
let us evaluate the integral of ( du/dt)<f>(t ), using integration by parts: 


/ OO J 00 r oo 

dt = u(t)4>{t) - h 

-OO ^ —OO J — OO 

rOO 

= <t>( 00 ) - 0 - / 0(f) 

Vo 


u(t)4>(t) dt 


= < t >{ 00) - 


This result shows that du/dt satisfies the sampling property of 5(t). Therefore it is 
an impulse <5(f) in the generalized sense — that is, 


Consequently 




f 8 (t) dr = u(t) 
J — OO 


These results can also be obtained graphically from Fig. 1.19b. We observe 
that the area from -00 to t under the limiting form of 8(t) in Fig. 1.19b is zero if 
t < 0 and unity if t > 0. Consequently 


f <5(r)dr=(° 

J — OO ^ 1 


Derivatives of impulse function can also be defined as generalized functions (see 
Prob. 1.4-10). 


A Exercise El. 9 

Show that 

(a) (t 3 + 3 )S(t) = 3 «(t) 

(c) e~ 2t S(t) = S(t) 

Hint: Use Eqs. (1.23). V 

A Exercise El.lO 
Show that 

/•oo 

(a) / dt = 1 


a <*-t>{(2 - t) dt = e~ 2< - x - 2) 


(b) [sin (t 2 - f )] 5(t) = -S(t) 


(b) f 8(t — 2) cos dt = 0 

J — OO / 


Hint: In part c recall that <5(x) is located at x — 0. Therefore <5(2 — t) is located at 2 — t — 0; that 
is at t s= 2. V 
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Fig. 1.21 Sinusoids of complex frequency a + ju. 

3. The Exponential Function e st 

One of the most important functions in the area of signals and systems is the 
exponential signal e st , where s is complex in general, given by 

s = a + jui 

Therefore , 

e st = e (< T +J u ') t — = e CTt (cos uit + j sin ut) (1.30a) 

If j* = a - ju (the conjugate of s), then 

e »'* = = e at e~i ut = e at (cos u>t - j sin u>t) (1.30b) 

and , 

e^cosc ut= i(e st + e s ‘‘) (!-30c) 

Comparison of this equation with Euler’s formula shows that e st is a generalization 
of the function e Jwt , where the frequency variable j u is generalized to a complex 
variable s = a + ju. For this reason we designate the variable s as the complex 
frequency. From Eqs. (1.30) it follows that the function e si encompasses a large 
class of functions. The following functions are special cases of e . 

1 A constant k = ke ot (s = 0) 

2 A monotonic exponential e r,t (ui = 0, s = <r) 

3 A sinusoid cos int (a = 0, s = ±jw) 

4 An exponentially varying sinusoid e at cos ut (s = a ± jw) 

These functions are illustrated in Fig. 1.21. 

The complex frequency s can be conveniently represented on a complex fre- 
quency plane (s plane) as depicted in Fig. 1.22. The horizontal axis is the real axis 
(a axis), and the vertical axis is the imaginary axis {ju axis). The absolute value of 
the imaginary part of s is M (the radian frequency), which indicates the frequency 
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of oscillation of e at ; the real part a (the neper frequency) gives information about 
the rate of increase or decrease of the amplitude of e s( . For signals whose complex 
frequencies lie on the real axis (<r-axis, where u = 0), the frequency of oscillation 
is zero. Consequently these signals are monotonically increasing or decreasing ex- 
ponentials (Fig. 1.21a). For signals whose frequencies lie on the imaginary axis (ju> 
axis where a — 0), e at = 1. Therefore, these signals are conventional sinusoids with 
constant amplitude (Fig. 1.21b). The case a = 0 (<r = u> = 0) corresponds to a 
constant (dc) signal because e ot = 1. For the signals illustrated in Figs. 1.21c and 
1.21d, both a and w are nonzero; the frequency s is complex and does not lie on 
either axis. The signal in Fig. 1.21c decays exponentially. Therefore, a is negative, 
and s lies to the left of the imaginary axis. In contrast, the signal in Fig. 1.21d 
grows exponentially. Therefore, a is positive, and a lies to the right of the imagi- 
nary axis. Thus the s-plane (Fig. 1.21) can be differentiated into two parts: the left 
half-plane (LHP) corresponding to exponentially decaying signals and the right 
half-plane (RHP) corresponding to exponentially growing signals. The imaginary 
axis separates the two regions and corresponds to signals of constant amplitude. 

An exponentially growing sinusoid e 2t cos(5t + 9), for example, can be ex- 
pressed as a sum of exponentials e^ 2+j5 ) ! and e^ 2- * 5 '* with complex frequencies 
2 + j 5 and 2 - j'5, respectively, which lie in the RHP. An exponentially decaying 
sinusoid e~ 2t cos (5t + 6) can be expressed as a sum of exponentials e( _2 +J 5 ) t and 
e (— 2-j5)t com pi ex frequencies -2 + j 5 and -2 - j 5, respectively, which lie in 

the LHP. A constant amplitude sinusoid cos (5t + 0) can be expressed as a sum of ex- 
ponentials e j5t and e _j5f with complex frequencies ±j 5, which lie on the imaginary 
axis. Observe that the monotonic exponentials e ±2t are also generalized sinusoids 
with complex frequencies ±2. 
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Fig. 1.23 An even and an odd function of t. 


1.5 Even and Odd Functions 


A function f e (t) is said to be an even function of t if 

fe(t) = fe(-t) ( 1 - 31 ) 

and a function fo(t) is said to be an odd function of t if 

m = -u-t) (i-32) 

An even function has the same value at the instants t and -t for all values of t. 
Clearly, f e (t) is symmetrical about the vertical axis, as shown in Fig. 1.23a. On the 
other hand, the value of an odd function at the instant t is the negative of its value 
at the instant -t. Therefore, f 0 {t) is anti-symmetrical about the vertical axis, as 
depicted in Fig. 1.23b. 

1.5-1 Some Properties of Even and Odd Functions 

Even and odd functions have the following property: 

even function x odd function = odd function 
odd function x odd function = even function 
even function x even function = even function 

The proofs of these facts are trivial and follow directly from the definition of odd 
and even functions [Eqs. (1.31) and (1.32)]. 

Area 

Because f e (t) is symmetrical about the vertical axis, it follows from Fig. 1.23a 

that 


fe{t) dt 




fe(t)dt 


(1.33a) 


It is also clear from Fig. 1.23b that 

r f 0 (t)dt = 0 (1.33b) 

J —a 

These results can also be proved formally by using the definitions in Eqs. (1.31) and 
(1.32). We leave them as an exercise for the reader. 
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1.5-2 Even and Odd Components of a Signal 

Every signal f(t) can be expressed as a sum of even and odd components 
because 

m = i i/w + /(-*)] +j [/«-/(-*)] (i-34) 

' ' ' v ' 

even odd 

Prom the definitions in Eqs. (1.31) and (1.32), we can clearly see that the first 
component on the right-hand side is an even function, while the second component 
is odd. This is apparent from the fact that replacing t by -t in the first component 
yields the same function. The same maneuver in the second component yields the 
negative of that component. 

Consider the function 

/(*) = e~ at u(t) 

Expressing this function as a sum of the even and odd components f e (t) and 
we obtain 

f(t) = fe(t) + fo(t) 

where [from Eq. (1.34)] 


f e (t) = l[e- at u(t) + e“ t u(-t)] 

(1.35a) 

f a (t) = i [e-“*u(t) - e at u(— t)] 

(1.35b) 


1.6 Systems 

The function e~ at u(t) and its even and odd components are illustrated in Fig. 1.24. 
I Example l.S 

Find the even and odd components of e Jt . 

From Eq. (1.34) 

e jt = fe(t) + fait) 

where 

fe{t) = | [e 3 ‘ + e~ jt ] = cos t 

and 

fo(t) = I [e Jt - e~ 3 ‘] = j sin t ■ 

1.6 Systems 

As mentioned in Sec. 1.1, systems are used to process signals in order to modify 
or to extract additional information from the signals. A system may consist of 
physical components (hardware realization) or may consist of an algorithm that 
computes the output signal from the input signal (software realization). 

A system is characterized by its inputs, its outputs (or responses), and the 
rules of operation (or laws) adequate to describe its behavior. For example, in 
electrical systems, the laws of operation are the familiar voltage-current relation- 
ships for the resistors, capacitors, inductors, transformers, transistors, and so on, 
as well as the laws of interconnection (i.e., Kirchhoff’s laws). Using these laws, 
we derive mathematical equations relating the outputs to the inputs. These equa- 
tions then represent a mathematical model of the system. Thus a system is 
characterized by its inputs, its outputs, and its mathematical model. 

A system can be conveniently illustrated by a “black box” with one set of 
accessible terminals where the input variables /i(t), / 2 (f)- ■ • •> Si M are applied and 
another set of accessible terminals where the output variables yi(t), 2 / 2 (0> • ■ •> 
are observed. Note that the direction of the arrows for the variables in Fig. 1.25 is 
always from cause to effect. 



Fig. 1.25 Representation of a system. 

The study of systems consists of three major areas: mathematical modeling, 
analysis, and design. Although we shall be dealing with mathematical modeling, our 
main concern is with analysis and design. The major portion of this book is devoted 
to the analysis problem — how to determine the system outputs for the given inputs 
and a given mathematical model of the system (or rules governing the system). To 
a lesser extent, we will also consider the problem of design or synthesis how to 
construct a system which will produce a desired set of outputs for the given inputs. 
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Fig. 1.26 An example of a simple electrical system. 


Data Needed to Compute System Response 

In order to understand what data we need to compute a system response, 
consider a simple RC circuit with a current source f(t) as its input (Fig. 1.26). The 
output voltage y(t) is given by 

y(t) = Rf(t) + ^ [ f{r)dT (1.36a) 

The limits of the integral on the right-hand side are from -oo to t because this 
integral represents the capacitor charge due to the current /(f) flowing in the ca- 
pacitor, and this charge is the result of the current flowing in the capacitor from 
-oo. Now, Eq. (1.36a) can be expressed as 

y{t) = Rf(t) + ~ J f(r)dr + ^ jf /(r)dr (1.36b) 

The middle term on the right-hand side is uc(0)> the capacitor voltage at t = 0. 
Therefore t 

I/(t) = «c(0) + Rf(t) + ^ J / W dr (1.36c) 

This equation can be readily generalized as 

1 /* 4 

y(t) = vc(to) + Rf(t) + — / f(r)dr (1.36d) 

° J to 

From Eq. (1.36a), the output voltage y{t) at an instant t can be computed if we 
know the input current flowing in the capacitor throughout its entire past (-oo to 
t). Alternatively, if we know the input current f(t) from some moment to onward, 
then, using Eq. (1.36d), we can still calculate y(t) for t > t 0 from a knowledge of 
the input current, provided we know vc(to), the initial capacitor voltage (voltage 
at t 0 ). Thus v c (to) contains all the relevant information about the circuit’s entire 
past (-oo to to) that we need to compute y(t) for t > to- Therefore, the response 
of a system at t > to can be determined from its input (s) during the interval to to 
t and from certain initial conditions at t = to- 

In the preceding example, we needed only one initial condition. However, in 
more complex systems, several initial conditions may be necessary. We know, for 
example, that in passive RLC networks, the initial values of all inductor currents 
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and all capacitor voltages) are needed to determine the outputs at any instant t > 0 
if the inputs are given over the interval [0,t]. 

1.7 Classification of Systems 

Systems may be classified broadly in the following categories.) 

1. Linear and nonlinear systems; 

2. Constant-parameter and time-varying-parameter systems; 

3. Instantaneous (memoryless) and dynamic (with memory) systems; 

4. Causal and noncausal systems; 

5. Lumped-parameter and distributed-parameter systems; 

6. Continuous-time and discrete-time systems; 

7. Analog and Digital systems; 

1.7-1 Linear and Nonlinear Systems 
The Concept of Linearity 

A system whose output is proportional to its input is an example of a linear 
system. But linearity implies more than this; it also implies additivity property, 
implying that if several causes are acting on a system, then the total effect on 
the system due to all these causes can be determined by considering each cause 
separately while assuming all the other causes to be zero. The total effect is then 
the sum of all the component effects. This property may be expressed as follows: 
for a linear system, if a cause acting alone has an effect ei, and if another cause 
C2 , also acting alone, has an effect e 2 , then, with both causes acting on the system, 
the total effect will be ei + e 2 - Thus, if 

ci — * ei and C 2 — * e 2 (1-37) 

then for all ci and C 2 . 

Cl + C 2 ♦ €l 4- C2 (l-oo) 

In addition, a linear system must satisfy the homogeneity or scaling property, 
which states that for arbitrary real or imaginary number k, if a cause is increased 
fc-fold, the effect also increases fc-fold. Thus, if 

c — * e 

then for all real or imaginary k 

kc — > ke (1.39) 

Thus, linearity implies two properties: homogeneity (scaling) and additivityS. Both 
these properties can be combined into one property (superposition), which is 
expressed as follows: If 

ci — * ei and C 2 - — * e 2 

then for all values of constants ki and fc 2 , 

f Strictly speaking, independent inductor currents and capacitor voltages. 

| Other classifications, such as deterministic and probabilistic systems, are beyond the scope of 
this text and are not considered. 

$ A linear system must also satisfy the additional condition of smoothness, where small changes 
in the system’s inputs must result in small changes in its outputs. 
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fclCi + &2 c 2 * ^l e l + *2 e 2 (1-40) 

This is true for all c i and c 2 . 

It may appear that additivity implies homogeneity. Unfortunately, there are 
cases where homogeneity does not follow from additivity. See the case in Exercise 
El. 11 below. 

A Exercise El. 11 

Show that a system with the input (cause) c(t) and the output (effect) eft) related by eft) = 
Re{c(t)} satisfies the additivity property but violates the homogeneity property. Hence, such a 
system is not linear. 

Hint: show that Eq. (1.39) is not satisfied when k is complex. V 

Response of a Linear System 

For the sake of simplicity, we discuss below only single-input, single-output 
(SISO) systems. But the discussion can be readily extended to multiple-input, 
multiple-output (MIMO) systems. 

A system’s output for t > 0 is the result of two independent causes: the initial 
conditions of the system (or the system state) at t = 0 and the input / (4) for 4 > 0. 
If a system is to be linear, the output must be the sum of the two components 
resulting from these two causes: first, the zero-input response component that 
results only from the initial conditions at 4 = 0 with the input f(t) = 0 for 4 > 0, 
and then the zero-state response component that results only from the input f(t) 
for 4 > 0 when the initial conditions (at 4 = 0) are assumed to be zero. When all 
the appropriate initial conditions are zero, the system is said to be in zero state. 
The system output is zero when the input is zero only if the system is in zero state. 

In summary, a linear system response can be expressed as the sum of a zero- 
input and a zero-state component: 

Total response = zero-input response + zero-state response (1.41) 


This property of linear systems which permits the separation of an output into 
components resulting from the initial conditions and from the input is called the 
decomposition property. 

For the RC circuit of Fig. 1.26, the response y(4) was found to be [see Eq. 


(1.36c)] 


y(t) = uc(0) 




}(r)dr 


z—i component 


z—s component 


From Eq. (1.42), it is clear that if the input /(f) = 0 for 4 > 0, the output y(4) = 
u C (0). Hence uc(0) is the zero-input component of the response y(t ). Similarly, if 
the system state (the voltage vc in this case) is zero at f = 0, the output is given 
by the second component on the right-hand side of Eq. (1.42). Clearly this is the 
zero-state component of the response y(t). 

In addition to the decomposition property, linearity implies that both the zero- 
input and zero-state components must obey the principle of superposition with 
respect to each of their respective causes. For example, if we increase the initial 
condition fc-fold, the zero-input component must also increase fc-fold. Similarly, if 
we increase the input fc-fold, the zero-state component must also increase fc-fold. 
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These facts can be readily verified from Eq. (1.42) for the RC circuit in Fig. 1.26. 
For instance, if we double the initial condition uc(0), the zero-input component 
doubles; if we double the input /(t), the zero-state component doubles. 

■ Example 1.9 

Show that the system described by the equation 

f + 3 y(t) = f(t) (1.43) 

is linear. 

Let the system response to the inputs fi(t) and f 2 (t) be yi(t) and j/ 2 (t), respectively. 
Then 

^• + 3 yi(t) = /r(t) 

and 

^+3»2(t) = /2(t) 

Multiplying the first equation by fci, the second with fc 2 , and adding them yields 


- 7 - [fciyi(t) + fc 22 / 2 (t)l + 3 [fciyi(t) + k2V2(t)] = fci/i(t) + * 2 / 2 ( 4 ) 

at 

But this equation is the system equation [Eq. (1 .43)] with 

/(f) = fci/i(t) + * 2 / 2 ( 4 ) 

and 

3/(4) = *iyi(<) + * 23 / 2 ( 4 ) 

Therefore, when the input is * 1/1 (4) + * 2 / 2 ( 4 ), the system response is *xyi(f) + * 2 y 2 (t). 
Consequently, the system is linear. Using this argument, we can readily generalize the 
result to show that a system described by a differential equation of the form 


d n y ^ dC_y 
dt n an 1 dt n ~ l 


• + O-OV — bm - 


■bif t + b o f 


is a linear system. The coefficients a» and in this equation can be constants or functions 
of time. I 


A Exercise EX. 12 

Show that the system described by the following equation is linear: 

!|+t 2 y(4) = (2t + 3)/(f) V 
at 

A Exercise El. 13 

Show that a system described by the following equation is nonlinear: 

v(t) % +3y(t) = /(t) v 


More Comments on Linear Systems 

Almost all systems observed in practice become nonlinear when large enough 
signals are applied to them. However, many systems show linear behavior for small 
signals. The analysis of nonlinear systems is generally difficult. Nonlinearities can 
arise in so many ways that describing them with a common mathematical form 
is impossible. Not only is each system a category in itself, but even for a given 
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system, changes in initial conditions or input amplitudes may change the nature of 
the problem. On the other hand, the superposition property of linear systems is a 
powerful unifying principle which allows for a general solution. The superposition 
property (linearity) greatly simplifies the analysis of linear systems. Because of 
the decomposition property, we can evaluate separately the two components of the 
output. The zero-input component can be computed by assuming the input to 
be zero, and the zero-state component can be computed by assuming zero initial 
conditions. Moreover, if we express an input /(f) as a sum of simpler functions, 

f(t) = ai/i(t) + 02 / 2 ( 4 ) + 1- a m f m (t) 

then, by virtue of linearity, the response y(t) is given by 

y(t) = au/i(t) + Q2l/2(f) H + «mSm(i) (1-45) 

where yk(t) is the zero-state response to an input fk(t). This apparently trivial 
observation has profound implications. As we shall see repeatedly in later chapters, 
it proves extremely useful and opens new avenues for analyzing linear systems. 



Fig. 1.27 Signal representation in terms of impulse and step components. 


As an example, consider an arbitrary input /(f) such as the one shown in 
Fig. 1.27a. We can approximate /(t) with a sum of rectangular pulses of width 
At and of varying heights. The approximation improves as At — * 0, when the 
rectangular pulses become impulses spaced At seconds apart (with At — * 0). Thus, 
an arbitrary input can be replaced by a weighted sum of impulses spaced At (At — > 
0) seconds apart. Therefore, if we know the system response to a unit impulse, 
we can immediately determine the system response to an arbitrary input /(f) by 
adding the system response to each impulse component of /(f). A similar situation 
is depicted in Fig. 1.27b, where /(f) is approximated by a sum of step functions of 
varying magnitude and spaced At seconds apart. The approximation improves as 
At becomes smaller. Therefore, if we know the system response to a unit step input, 
we can compute the system response to any arbitrary input /(t) with relative ease. 
Time-domain analysis of linear systems (discussed in Chapter 2) uses this approach. 

In Chapters 4,6,10, and 11 we employ the same approach but instead use 
sinusoids or exponentials as our basic signal components. There, we show that 
any arbitrary input signal can be expressed as a weighted sum of sinusoids (or 
exponentials) having various frequencies. Thus a knowledge of the system response 
to a sinusoid enables us to determine the system response to an arbitrary input 
/(*)• 
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0 T 0 T 

(b) 


Fig. 1.28 Time-invariance property. 

1.7-2 Time-Invariant and Time-Varying Parameter Systems 

Systems whose parameters do not change with time are time-invariant (also 
constant-parameter) systems. For such a system, if the input is delayed by T 
seconds, the output is the same as before but delayed by T (assuming identical 
initial conditions). This property is expressed graphically in Fig. 1.28. 

It is possible to verify that the system in Fig. 1.26 is a time-invariant system. 
Networks composed of RLC elements and other commonly used active elements 
such as transistors are time-invariant systems. A system with an input-output 
relationship described by a linear differential equation of the form (1-44) is a linear 
time-invariant (LTI) system when the coefficients a.i and 5* of such equation are 
constants. If these coefficients are functions of time, then the system is a linear 
time-varying system. The system described in exercise El. 12 is an example of a 
linear time-varying system. Another familiar example of a time-varying system is 
the carbon microphone, in which the resistance R is a function of the mechanical 
pressure generated by sound waves on the carbon granules of the microphone. An 
equivalent circuit for the microphone appears in Fig. 1.29. The response is the 
current i(t), and the equation describing the circuit is 

L^Sr+mw-m 

at 

One of the coefficients in this equation, R{t), is time- varying. 

A Exercise El. 14 

Show that a system described by the following equation is time- varying parameter system: 
y(t) = (sin t) f(t - 2) 

Hint: Show that the system fails to satisfy the time-invariance property. V 
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Fig. 1.29 An example of a linear time-varying system. 

1.7- 3 Instantaneous and Dynamic Systems 

As observed earlier, a system’s output at any instant t generally depends upon 
the entire past input. However, in a special class of systems, the output at any 
instant t depends only on its input at that instant. In resistive networks, for exam- 
ple, any output of the network at some instant t depends only on the input at the 
instant t. In these systems, past history is irrelevant in determining the response. 
Such systems are said to be instantaneous or memoryless systems. More pre- 
cisely, a system is said to be instantaneous (or memoryless) if its output at any 
instant t depends, at most, on the strength of its input(s) at the same instant but 
not on any past or future values of the input (s). Otherwise, the system is said to be 
dynamic (or a system with memory). A system whose response at t is completely 
determined by the input signals over the past T seconds [interval from (t - T) to 
f] is a finite-memory system with a memory of T seconds. Networks contain- 
ing inductive and capacitive elements generally have infinite memory because the 
response of such networks at any instant t is determined by their inputs over the 
entire past (-oo, t). This is true for the RC circuit of Fig. 1.26. 

In this book we will generally examine dynamic systems. Instantaneous systems 
are a special case of dynamic systems. 

1.7- 4 Causal and Noncausal Systems 

A causal (also known as a physical or non-anticipative) system is one for 
which the output at any instant to depends only on the value of the input f(t) for 
t < to . In other words, the value of the output at the present instant depends only 
on the past and present values of the input /(f), not on its future values. To put 
it simply, in a causal system the output cannot start before the input is applied. If 
the response starts before the input, it means that the system knows the input in 
the future and acts on this knowledge before the input is applied. A system that 
violates the condition of causality is called a noncausal (or anticipative) system. 

Any practical system that operates in real timef must necessarily be causal. 
We do not yet know how to build a system that can respond to future inputs (inputs 
not yet applied). A noncausal system is a prophetic system that knows the future 
input and acts on it in the present. Thus, if we apply an input starting at t = 0 
to a noncausal system, the output would begin even before t — 0. As an example, 
consider the system specified by 

y(t) = f(t-2) + f(t + 2) (1.46) 

fin real-time operations, the response to an input is essentially simultaneous (contempo- 
raneous) with the input itself. 
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Fig. 1.30 A noncausal system and its realization by a delayed causal system. 


For the input /(f) illustrated in Fig. 1.30a, the output y(t), as computed from 
Eq. (1.46) (shown in Fig. 1.30b), starts even before the input is applied. Equation 
(1.46) shows that y{t), the output at t, is given by the sum of the input values two 
seconds before and two seconds after t (at t - 2 and t + 2 respectively). But if we 
are operating the system in real time at t, we do not know what the value of the 
input will be two seconds later. Thus it is impossible to implement this system in 
real time. For this reason, noncausal systems are unrealizable in real time. 

Why Study Noncausal Systems? 

From the above discussion it may seem that noncausal systems have no practical 
purpose. This is not the case; they are valuable in the study of systems for several 
reasons. First, noncausal systems are realizable when the independent variable is 
other than “time” (e.g., space). Consider, for example, an electric charge of density 
q(x) placed along the x-axis for x > 0. This charge density produces an electric field 
E(x) that is present at every point on the x-axis from x — -oo to oo. In this case the 
input [i.e., the charge density g(x)] starts at x = 0, but its output [the electric field 
E(x ) j begins before x = 0. Clearly, this space charge system is noncausal. This 
discussion shows that only temporal systems (systems with time as independent 
variable) must be causal in order to be realizable. The terms “before” and “after” 
have a special connection to causality only when the independent variable is time. 
This connection is lost for variables other than time. NontemporaJ systems, such 
as those occurring in optics, can be noncausal and still realizable. 

Moreover, even for temporal systems, such as those used for signal processing, 
the study of noncausal systems is important. In such systems we may have all input 
data prerecorded. (This often happens with speech, geophysical, and meteorological 
signals, and with space probes.) In such cases, the input’s future values are available 
to us. For example, suppose we had a set of input signal records available for the 
system described by Eq. (1.46). We can then compute y(t) since, for any t, we need 
only refer to the records to find the input’s value two seconds before and two seconds 
after t. Thus, noncausal systems can be realized, although not in real time. We 
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Noncausal systems are realizable with time delay! 


may therefore be able to realize a noncausal system, provided that we are willing 
to accept a time delay in the output. Consider a system whose output y(t ) is the 
same as y(t) in Eq. (1.46) delayed by two seconds (Fig 1.30c), so that 

y(t ) = y(t - 2) 

= /(* — 4) + /(t) 

Here the value of the output y at any instant t is the sum of the values of the input 
/ at t and at the instant four seconds earlier [at (t - 4)]. In this case, the output 
at any instant t does not depend on future values of the input, and the system is 
causal. The output of this system, which is y(t), is identical to that in Eq. (1.46) 
or Fig. 1.30b except for a delay of two seconds. Thus, a noncausal system may be 
realized or satisfactorily approximated in real time by using a causal system with a 
delay. 

A third reason for studying noncausal systems is that they provide an upper 
bound on the performance of causal systems. For example, if we wish to design 
a filter for separating a signal from noise, then the optimum filter is invariably a 
noncausal system. Although unrealizable, this noncausal system’s performance acts 
as the upper limit on what can be achieved and gives us a standard for evaluating 
the performance of causal filters. 

At first glance, noncausal systems may seem inscrutable. Actually, there is 
nothing mysterious about these systems and their approximate realization through 
using physical systems with delay. If we want to know what will happen one year 
from now, we have two choices: go to a prophet (an unrealizable person) who can 
give the answers immediately, or go to a wise man and allow him a delay of one 
year to give us the answer! If the wise man is truly wise, he may even be able to 
shrewdly guess the future very closely with a delay of less than a year by studying 
trends. Such is the case with noncausal systems — nothing more and nothing less. 

A Exercise El. 15 

Show that a system described by the equation below is noncausal: 

rt + 5 

V(t) = / f(r)dr 

Jt - 5 

Show that this system can be realized physically if we accept a delay of 5 seconds in the output. 
V 
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1.7- 5 Lumped- Parameter and Distributed-Parameter Systems 

In the study of electrical systems, we make use of voltage-current relationships 
for various components (Ohm’s law, for example). In doing so, we implicitly assume" 
that the current in any system component (resistor, inductor, etc.) is the same at 
every point throughout that component. Thus, we assume that electrical signals are 
propagated instantaneously throughout the system. In reality, however, electrical 
signals are electromagnetic space waves requiring some finite propagation time. 
An electric current, for example, propagates through a component with a finite 
velocity and therefore may exhibit different values at different locations in the same 
component. Thus, an electric current is a function not only of time but also of 
space. However, if the physical dimensions of a component are small compared to 
the wavelength of the signal propagated, we may assume that the current is constant 
throughout the component. This is the assumption made in lumped-parameter 
systems, where each component is regarded as being lumped at one point in space. 
Such an assumption is justified at lower frequencies (higher wavelength). Therefore, 
in lumped-parameter models, signals can be assumed to be functions of time alone. 
For such systems, the system equations require only one independent variable (time) 
and therefore are ordinary differential equations. 

In contrast, for distributed-parameter systems such as transmission lines, 
waveguides, antennas, and microwave tubes, the system dimensions cannot be as- 
sumed to be small compared to the wavelengths of the signals; thus the lumped- 
parameter assumption breaks down. The signals here are functions of space as 
well as of time, leading to mathematical models consisting of partial differential 
equations. 3 The discussion in this book will be restricted to lumped-parameter sys- 
tems only. 

1.7- 6 Continuous-Time and Discrete-Time Systems 

Distinction between discrete-time and continuous-time signals is discussed in 
Sec. 1.2-1. Systems whose inputs and outputs are continuous-time signals are 
continuous-time systems. On the other hand, systems whose inputs and out- 
puts are discrete-time signals are discrete-time systems. If a continuous-time 
signal is sampled, the resulting signal is a discrete-time signal. We can process a 
continuous-time signal by processing its samples with a discrete-time system. 

1.7- 7 Analog and Digital Systems 

Analog and digital signals are discussed in Sec. 1.2-2. A system whose input 
and output signals are analog is an analog system; a system whose input and 
output signals are digital is a digital system. A digital computer is an example 
of a digital (binary) system. Observe that a digital computer is an example of a 
system that is digital as well as discrete-time. 

Additional Classification of Systems 

There are additional classes of systems, such as invertible and noninvertible 
systems. A system 5 performs certain operation(s) on input signal(s). If we can 
obtain the input f(t) back from the output y(t ) by some operation, the system 




88 


1 Introduction to Signals and Systems 


S is said to be invertible. For a noninvertible system, different inputs can result 
in the same output (as in a rectifier), and it is impossible to determine the input 
for a given output. Therefore, for an invertible system, it is essential that distinct 
inputs result in distinct outputs so that there is one-to-one mapping between an 
input and the corresponding output. This ensures that every output has a unique 
input. Consequently, the system is invertible. The system that achieves this inverse 
operation [of obtaining f(t) from y(t)} is the inverse system of S. For instance, 
A system whose input and output are related by equation y(t) = a f(t) + 6 is 
an invertible system. But a rectifier, specified by the equation y(t) = |/(f)| is 
noninvertible because the rectification operation cannot be undone. 

An ideal differentiator is noninvertible because integration of its output cannot 
restore the original signal unless we know one piece of information about the signal. 
For instance, if f (t) = 3t + 5, the output of the differentiator is y(t) = 3. If this 
output is applied to an integrator, the output is 3 1 + c, where c is an arbitrary 
constant. If we know one piece of information about /(t), such as /( 0) = 5, we can 
determine the input to be f(t) ~ 3t -t- 5. Thus, a differentiator along with one piece 
of information (known as auxiliary condition) is an invertible system. f Similarly, 
a system consisting of a cascade of two differentiators is invertible, if we know two 
independent pieces of information (auxiliary conditions) about the input signal. 

In addition, systems can also be classified as stable or unstable systems. The 
concept of stability is discussed in more depth in later chapters. 

A Exercise El. IS 

Show that a system described by the equation y(t) = / 2 (t) is noninvertible. v 


1.8 System Model: Input-output Description 

As mentioned earlier, systems theory encompasses a variety of systems, such 
as electrical, mechanical, hydraulic, acoustic, electromechanical, and chemical, as 
well as social, political, economic, and biological. The first step in analyzing any 
system is the construction of a system model, which is a mathematical expression 
or a rule that satisfactorily approximates the dynamical behavior of the system. 
In this chapter we shall consider only the continuous-time systems. (Modeling of 
discrete-time systems is discussed in Chapter 8.) 

To construct a system model, we must study the relationships between differ- 
ent variables in the system. In electrical systems, for example, we must determine 
a satisfactory model for the voltage-current relationship of each element, such as 
Ohm s law for a resistor. In addition, we must determine the various constraints on 
voltages and currents when several electrical elements are interconnected. These are 
the laws of interconnection— the well-known Kirchhoff’s voltage and current laws 
(KVL and KCL). From all these equations, we eliminate unwanted variables to 
obtain equation(s) relating the desired output variable(s) to the input(s). The fol- 
lowing examples demonstrate the procedure of deriving input-output relationships 
for some LTI electrical systems. 

fThe additional piece of information cannot be just any information. For instance, in the above 
example, if we are given /( 0) — 0, it will not help in determining c, and the system is noninvertible. 
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L= 1 H R= 3Q 



Fig. 1.31 Circuit for Example 1.10. 


■ Example 1.10 

For the series RLC circuit of Fig. 1.31, find the input-output equation relating the 
input voltage f(t) to the output current (loop current) y(t). 

Application of the Kirchhoff’s voltage law around the loop yields 

vr(t) + VR(t) + vc(t) = f(t) (1-47) 

By using the voltage-current laws of each element (inductor, resistor, and capacitor), we 
can express this equation as 

^ + 3y(f) + 2 J y(r)dT = f(t) (1.48) 

Differentiating both sides of this equation obtains 

$ + 3§ +«.)-£ <■•«> 

This differential equation is the input-output relationship between the output y(t) 
and the input f(t). H 

It proves convenient to use a compact notation D for the differential operator 
Tf Tims 

5 = D V (t) (1.50) 

at 

and so on. With this notation, Eq. (1.49) can be expressed as 

[D 2 + 3D +2)y(t) = Df(t) (1.52) 

The differential operator is the inverse of the integral operator, so we can use 
the operator 1/D to represent integration!. 


y(r)d.T = — y(i) 


f Use of operator 1/D for integration generates some subtle mathematical difficulties because 
the operators D and 1/D do not commute. For instance, we know that D(l/D) = 1 because 
ft[floo y ^ dT ] ” V(*)- However, -^D is not necessarily unity. Use of Cramer’s rule in solving 
simultaneous integro-differential equations will always result in cancellation of operators 1/D and 
D. This procedure may yield erroneous results in those cases where the factor D occurs in the 
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fi=15Q 



Fig. 1.32 Circuit for Example 1.11. 

Consequently, the loop equation (1.48) can be expressed as 

+ 3 + — ^ y(t) = f(t) (1-54) 

Multiplying both sides by D, that is, differentiating Eq. (1.54), we obtain 

(D 2 + 3D + 2) y(t) = DJ{t) (1.55) 

which is identical to Eq. (1.52). 

Recall that Eq. (1.55) is not an algebraic equation, and D 2 + 3D + 2 is not an 
algebraic term that multiplies y(t)\ it is an operator that operates on y(t). It means 
that we must perform the following operations on y(t): take the second derivative 
of y{t) and add to it 3 times the first derivative of y(t) and 2 times y(t). Clearly, 
a polynomial in D multiplied by y(t) represents a certain differential operation on 
»(*)• 

■ Example 1.11 

Find the equation relating the input to output for the series RC circuit of Fig. 1.32 
if the input is the voltage f(t) and output is (a) the loop current x(t) (b) the capacitor 
voltage y(t). 

The loop equation for the circuit is 

Rx(t) + i J x(r)dT = }{t) (1.56) 

or 

15x(t) + 5 f x(r)dT = f(t) (1-57) 

J — OO 

With operational notation, this equation can be expressed as 

numerator as well as in the denominator. This happens, for instance, in circuits with all-inductor 
loops or all-capacitor cutsets. To eliminate this problem, avoid the integral operation in system 
equations so that the resulting equations are differential rather than integro-differential. In elec- 
trical circuits, this can be done by using charge (instead of current) variables in loops containing 
capacitors and using current variables for loops without capacitors. In the literature this problem 
of commutativity of D and 1/D is largely ignored. As mentioned earlier, such procedure gives er- 
roneous results only in special systems, such as the circuits with all-inductor loops or all-capacitor 
cutsets. Fortunately such systems constitute a very small fraction of the systems we deal with. 
For further discussion of this topic and a correct method of handling problems involving integrals, 
see Ref. 4 
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15*(t) + ^*(t) = fit) (1-58) 

Multiplying both sides of the above equation by D (that is, differentiating the above 
equation), we obtain 

(15D + 5 )x{t) = Df(t) (1.59a) 

or 

15^ + 5 x(t) = — (1.59b) 

dt at 

Moreover, 

= |oy(*) 

Substitution of this result in Eq. (1.59a) yields 

(3D + l)y(t) = /(<) ( L6 °) 

0r J 

3 ^+»(t) = /W (!- 61 ) 

dt 

■ 

A Exercise El. 17 ...... ...... 

For the RLC circuit in Fig. 1.31, find the input-output relationship if the output is the 

inductor voltage vi ,((). 

Hint: V£,(t) = LDy{t) = Dy(t). Answer: ( D 2 + 3D + 2) v L (t) = D 2 f(t) V 

For the RLC circuit in Fig. 1.31, find the input-output relationship if the output is the 
capacitor voltage v c(t)- 

Hint: v c (t) = ^y(t) = %y(t). Answer: (D 2 + 3D + 2) v c (t) = 2f(t) V 



Fig. 1.33 Armature controlled dc motor. 


I Example 1.12 

In rotational systems, the equations of motion are similar to those in translational 
systems. In place of force F, we have torque T. In place of mass M, we have moment 
of inertia J (the rotational mass), and in place of linear acceleration s, we have angular 
acceleration 9. The equation of motion for rotational systems is T = JO (in place of 

F = Mi). . 

A wide variety of electromechanical systems convert electrical signals into mechanical 
motion (mechanical energy) and vice versa. Here we consider a rather simple example of 
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an armature-controlled dc motor (with a constant field current if) driven by a current 
source f(t), as depicted in Fig. 1.33a. Let 8(t) be the angular position of the rotor. The 
torque T(t) generated in the rotor is proportional to the armature current f{t). Therefore 

T(t) = K T f(t) (1-62) 

where Kt is a constant of the motor. This torque drives a mechanical load whose free- 
body diagram is illustrated in Fig. 1.33b. The viscous damping (with coefficient B), which 
is proportional to the angular velocity 6, dissipates a torque B8(t). If J is the moment of 
inertia of the load (including the rotor of the motor), then the net torque T(t) - B0(t) 
available must equal to J6(t)\ 


J9{t) = T(t) - B8(t) 

Thus 

(1.63) 

(JD 2 + BD) 8{t) = T(t) 


= K T f(t) 

(1.64) 

which can be expressed as 


D(D + a)8{t) = K\f(t) 

(1.65) 

where a = B/J and K 1 = Kt/J- 

■ 


1.8-1 Internal and External Descriptions of a System 

With a knowledge of the internal structure of a system, we can write system 
equations yielding an internal description of the system. In contrast, the sys- 
tem description seen from the system’s input and output terminals is the system’s 
external description. To understand an external description, suppose that a sys- 
tem is enclosed in a “black box” with only its input(s) and output(s) terminals 
accessible. In order to describe or characterize such a system, we must perform 
some measurements at these terminals. For example, we might apply a known in- 
put, such as a unit impulse or a unit step, and then measure the system’s output. 
The description provided by such a measurement is an external description of the 
system. 

Suppose the circuit in Fig. 1.34a with the input f(t ) and the output y{t) is 
enclosed inside a “black box” with only the input and output terminals accessible. 
Under these conditions the only way to describe or specify the system is with exter- 
nal measurements. We can, for example, apply a known voltage / (f ) at the input 
terminals and measure the resulting output voltage y(t). From this information we 
can describe or characterize the system. This is the external description. 

Assuming zero initial capacitor voltage, the input voltage /(f) produces a cur- 
rent i (Fig. 1.34a), which divides equally between the two branches because of the 
balanced nature of the circuit. Thus, the voltage across the capacitor continues to 
remain zero. Therefore, for the purpose of computing the current i, the capacitor 
may be removed or replaced by a short. The resulting circuit is equivalent to that 
shown in Fig. 1.34b. It is clear from Fig. 1.34b that f(t) sees a net resistance of 
5H, and 

i(t) = \f(t) 

Also, because y(t) - 2 x (i/2) = i, 

y(t) = |/W 



fit) an 

r—Wr 





i n 


Fig. 1.34 A system that cannot be described by external measurements. 


The equivalent system as seen from the system’s external terminals is depicted in 
Fig. 1.34b. Clearly, for the external description, the capacitor does not exist. For 
most systems, the external and internal descriptions are identical, but there are a 
few exceptions, as in the present case, where the external description gives an inad- 
equate picture of the systems. This happens when the system is uncontrollable 
and/or unobservable. Figures 1.35a and 1.35b show a structural representation 
of simple uncontrollable and unobservable systems respectively. In Fig. 1.35a we 
note that part of the system (subsystem S 2 ) inside the box cannot be controlled by 
the input f(t). In Fig. 1.35b some of the system outputs (those in subsystem S 2 ) 
cannot be observed from the output terminals. If we try to describe either of these 
systems by applying an external input f(t) and then measuring the output y(t), 
the measurement will not characterize the complete system but only the part of the 
system (here Si) that is both controllable and observable (linked to both the input 
and output). Such systems are undesirable in practice and should be avoided in any 
system design. The system in Fig. 1.35a can be shown to be neither controllable 
nor observable. It can be represented structurally as a combination of the systems 
in Figs. 1.35a and 1.35b. 



(a) (b) 

Fig. 1.35 Structures of uncontrollable and unobservable systems. 


( 1 . 66 ) 
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1.9 Summary 

A signal is a set of information or data. A system processes input signals 
to modify them or extract additional information from them to produce output 
signals (response). A system may be made up of physical components (hardware 
realization) or may be an algorithm that computes an output signal from an input 
signal (software realization). 

A convenient measure of the size of a signal is its energy if it is finite. If the 
signal energy is infinite, the appropriate measure is its power, if it exists. The signal 
power is the time average of its energy (averaged over the entire time interval from 
— oo to oo ). For periodic signals the time averaging need be performed only over 
one period in view of the periodic repetition of the signal. Signal power is also equal 
to the mean squared value of the signal (averaged over the entire time interval from 
t — —oo to oo). 

Signals can be classified in several ways as follows: 

1. A continuous-time signal is specified for a continuum of values of the indepen- 
dent variable (such as time f). A discrete-time signal is specified only at a finite 
or a countable set of time instants. 

2. An analog signal is a signal whose amplitude can take on any value over a con- 
tinuum. On the other hand, a signal whose amplitudes can take on only a finite 
number of values is a digital signal. The terms discrete-time and continuous- 
time qualify the nature of a signal along the time axis (horizontal axis). The 
terms analog and digital, on the other hand, qualify the nature of the signal 
amplitude (vertical axis). 

3. A periodic signal f(t) is defined by the fact that f(t) = f(t + To) for some 
To- The smallest value of To for which this relationship is satisfied is called the 
period. A periodic signal remains unchanged when shifted by an integral mul- 
tiple of its period. A periodic signal can be generated by a periodic extension 
of any segment of f(t) of duration To. Finally, a periodic signal, by definition, 
must exist over the entire time interval -oo < t < oo. A signal is aperiodic if 
it is not periodic. 

An everlasting signal starts at t = — oo and continues forever to t = oo. A 
causal signal is a signal that is zero for t < 0. Hence, periodic signals are 
everlasting signals. 

4. A signal with finite energy is an energy signal. Similarly a signal with a finite 
and nonzero power (mean square value) is a power signal. A signal can either 
be an energy signal or a power signal, but not both. However, there are signals 
that are neither energy nor power signals. 

5. A signal whose physical description is known completely in a mathematical or 
graphical form is a deterministic signal. A random signal is known only in 
terms of its probabilistic description such as mean value, mean square value, 
and so on, rather than its mathematical or graphical form. 

A signal f(t) delayed by T seconds (right-shifted) is given by f(t - T); on the 
other hand, }{t ) advanced by T (left-shifted) is given by f(t + T). A signal /(f) 
time-compressed by a factor a (a > 1) is given by / (at); on the other hand, the same 


signal time-expanded by factor a is given by /(£). The same signal time-inverted 
is given by 

The unit step function u(t) is very useful in representing causal signals and 
signals with different mathematical descriptions over different intervals. 

In the classical definition, the unit impulse function <5(f) is characterized by 
unit area, and the fact that it is concentrated at a single instant t = 0. The impulse 
function has a sampling (or sifting) property, which states that the area under the 
product of a function with a unit impulse is equal to the value of that function at 
the instant where the impulse is located (assuming the function to be continuous 
at the impulse location). In the modern approach, the impulse function is viewed 
as a generalized function and is defined by the sampling property. 

The exponential function e st , where s is complex, encompasses a large class 
of signals that includes a constant, a monotonic exponential, a sinusoid, and an 
exponentially varying sinusoid. 

A signal that is symmetrical about the vertical axis (t = 0) is an even function 
of time, and a signal that is antisymmetrical about the vertical axis is an odd 
function of time. The product of an even function with an odd function results in 
an odd function. However, the product of an even function with an even function or 
an odd function with an odd function results in an even function. The area under 
an odd function from t = -a to a is always zero regardless of the value of a. On 
the other hand, the area under an even function from t = -a to a is two times the 
area under the same function from t = 0 to a (or from t — -a to 0). Every signal 
can be expressed as a sum of odd and even function of time. 

A system processes input signals to produce output signals (response). The 
input is the cause and the output is its effect. In general, the output is affected 
by two causes: the internal conditions of the system (such as the initial conditions) 
and the external input. 

Systems can be classified in several ways: 

1. Linear systems are characterized by the linearity property, which implies su- 
perposition; if several causes (such as various inputs and initial conditions) are 
acting on a linear system, the total effect (response) is the sum of the responses 
from each cause, assuming that all the remaining causes are absent. A system 
is nonlinear if it is not linear. 

2. Time-invariant systems are characterized by the fact that system parameters 
do not change with time. The parameters of time-varying parameter systems 
change with time. 

3. For memoryless (or instantaneous) systems, the system response at any instant 
t depends only on the present value of the input (value at t). For systems with 
memory (also known as dynamic systems), the system response at any instant t 
depends not only on the present value of the input, but also on the past values 
of the input (values before t). 

4. In contrast, if a system response at t also depends on the future values of the 
input (values of input beyond t), the system is noncausal. In causal systems, 
the response does not depend on the future values of the input. Because of the 
dependence of the response on the future values of input, the effect (response) 
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of noncausal systems occurs before cause. When the independent variable is 
time (temporal systems), the noncausal systems are prophetic systems, and 
therefore, unrealizable, although close approximation is possible with some 
time delay in the response. Noncausal systems with independent variables 
other than time (e.g., space) are realizable. 

5. If the dimensions of system elements are small compared to the wavelengths of 
the signals, we may assume that each element is lumped at a single point in 
space, and the system may be considered as a lumped-parameter system. The 
signals under this assumption are functions of time only. If this assumption 
does not hold, the signals are functions of space and time; such a system is a 
distributed-parameter system. 

6. Systems whose inputs and outputs are continuous-time signals are continuous- 
time systems; systems whose inputs and outputs are discrete-time signals are 
discrete-time systems. If a continuous-time signal is sampled, the resulting 
signal is a discrete-time signal. We can process a continuous-time signal by 
processing the samples of this signal with a discrete-time system. 

7. Systems whose inputs and outputs are analog signals are analog systems; those 
whose inputs and outputs are digital signals are digital systems. 

8. If we can obtain the input f(t) back from the output y(t) of a system S by 
some operation, the system S is said to be invertible. Otherwise the system is 
noninvertible. 

The system model derived from a knowledge of the internal structure of the 
system is its internal description. In contrast, an external description of a system 
is its description as seen from the system’s input and output terminals; it can be 
obtained by applying a known input and measuring the resulting output. In the 
majority of practical systems, an external description of a system so obtained is 
equivalent to its internal description. In some cases, however, the external descrip- 
tion fails to give adequate information about the system. Such is the case with the 
so-called uncontrollable or unobservable systems. 
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Problems 

1 . 1 - 1 Find the energies of the signals illustrated in Fig. PI. 1-1. Comment on the effect on 

energy of sign change, time shifting, or doubling of the signal. What is the effect on 
the energy if the signal is multiplied by fc? 

1.1- 2 Repeat Prob. 1.1-1 for the signals in Fig. PI. 1-2. 

1.1- 3 (a) Find the energies of the pair of signals x(t) and y(t) depicted in Figs. Pl.l-3a 

and b. Sketch and find the energies of signals x(t) + y{t) and x(t) - y(t). Can you 
make any observation from these results? 
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1.1- 4 Find the power of the periodic signal /(f) shown in Fig, PI, 1-4. Find also the powers 

and the rms values of: (a) —fit) (b) 2/(f) (c) c/(f). Comment. 

fU) 

a aJlLl a, 

V KJ r • Y 

Fig. PI. 1-4 

1.1- 5 Show that the power of a signal 

n n 

m = Y Dkeiu>kt is p f = Y |Dfc|2 

k—m k=m 

assuming all frequencies to be distinct, that is, uh ^ u k for all i yt k 

1.1- 6 Determine the power and the rms value for each of the following signals: 

(a) 10 cos ^100t + ^ (b) 10 cos ^100t + ^ + 16 sin ^150t + ^ 

(c) (10 + 2 sin 3t) cos lOf (d) 10 cos 5t cos lOt 

(e) 10 sin 5t cos lOt (f ) e Jat cos wot 

1.3-1 In Fig. PI. 3-1, the signal /i (t) = Express signals / 3 (f), / 4 (f), and /s(t) 

in terms of signals /(t), and their time-shifted, time-scaled or time-inverted 

versions. For instance / 2 (f) = f(t — T) + /i(t — T). 



Fig. PI. 3-1 


1.3- 2 For the signal /(t) depicted in Fig, PI. 3-2, sketch the signals: (a) /(— f) (b) /(t + 6) 

(c) /(3t) (d) /(|). 

1.3- 3 For the signal f(t) illustrated in Fig. PI. 3-3, sketch (a) /(f — 4) (b) /( -^g) (c) /(— t) 

(d) /(2t-4) (e)/(2-t). 
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Fig. PI. 3-3 



Fig. PI. 4-2 


1.4- 1 Sketch the signals (a) u(f-5)-u(t-7) (b) u(t-5)+u(t-7) (c) t 2 [u(t-l)-u(t 2)] 

(d) (t - 4)[u(t - 2) - u(t - 4)] 

1.4- 2 Express each of the signals in Fig. Pl.4-2 by a single expression valid for all t. 

1.4- 3 For an energy signal /(t) with energy £ 7 , show that the energy of any one of the 

signals -/(t), /(— t) and f(t - T) is £/. Show also that the energy of /(at) as well 
as /(at - 6 ) is £//a. This shows that time-inversion and time-shifting does not affect 
signal energy. On the other hand, time compression of a signal (a > 1) reduces the 
energy, and time expansion of a signal (a < 1) increases the energy. What is the 
effect on signal energy if the signal is multiplied by a constant a? 

1.4- 4 Simplify the following expressions: 


<■> (&)«> 

(c) [e _t cos (3t - 60°)] 6(t) 

<•> 



Hint: Use Eq. (1.23). For part (f) use L’Hopital’s rule. 
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1.4-5 Evaluate the following integrals: 


(a) 

poo 

/ 6{j)f(t-T)dT 

J — OO 

(e) 

poo 

I 6(t + S)e~ t dt 

J — OO 

(b) 

poo 

/ f(r)S(t-T)dT 

J —OO 

(0 

poo 

/ (t 3 + 4)6(1 -t)dt 

J — OO 

(c) 

poo 

/ 8(t)e~ iut dt 

J — OO 

(g) 

poo 

/ /(2 — t)i5(3 — f) dt 

J — OO 

(d) 

poo 

/ <5(t - 2) sin jrf dt 

J — OO 

(h) 

poo 

/ cos [|(x - 5)] S(x — 3) dx 

J — OO 


Hint: S(x) is located at x = 0. For example, 5(1 - t) is located at 1 - t = 0, and so 
on. 

1.4-6 (a) Find and sketch df/dt for the signal f(t) shown in Fig. Pl.3-3. 

(b) Find and sketch d 2 f/dt 2 for the signal f(t) depicted in Fig. P1.4-2a. 



.4-11 A sinusoid e' Jt cos ut can be expressed as a sum of exponentials e 3t and e~ st (Eq. 
(1.30c) with complex frequencies s = a + jw and s = a - ju i. Locate in the com- 
plex plane the frequencies of the following sinusoids: (a) cos 3t (b) e~ 3t cos 3t (c) 
e 2t cos 3t (d) e _2t (e) e 2t (f) 5. 
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1.5- 1 Find and sketch the odd and the even components of (a) u(t) (b) tu(t) (c) sin aio tu(t) 

(d) cos uatu(t) (e) sin ojot (f) cos uiot. 

1.6- 1 Write the input-output relationship for an ideal integrator. Determine the zero-input 

and zero-state components of the response. 

1.7- 1 For the systems described by the equations below, with the input f(t) and output 

y(t), determine which of the systems are linear and which are nonlinear. 

(a) f|+2j,(t) = / 2 (t) 

(b) ^ + 3 ty(t) = t*f(t) 

(e) (*) + 2 wW = /W 

(d) |+y 2 (t) = /(t) 


(c) 3 y{t) + 2 = }{t) 

(f) f + (sin t)y(t) = f t +2f(t) 

(h) y(t) = [ f(r)dr 


1.7- 2 For the systems described by the equations below, with the input f(t) and output 

y(t), determine which of the systems are time-invariant parameter systems and which 
are time- varying parameter systems. 

(d) y(t) = tf(t — 2) 

(e) y(t) = J f[r) dr 

-Mir 

1.7- 3 For a certain LTI system with the input /(£), the output y(t) and the two initial 

conditions xi(0) and 2:2(0), following observations were made: 


m 

xi(0) 

x 2 (0) 

y{t ) 

0 

1 

-1 

e~ t u(t) 

0 

2 

1 

e -t (3t + 2)u(t) 

u{t) 

-1 

-1 

2 u(t) 


Determine y(t) when both the initial conditions are zero and the input /(£) is as 
shown in Fig. PI. 7-3. 

Hint: There are three causes: the input and each of the two initial conditions. Because 
of linearity property, if a cause is increased by a factor k , the response to that cause 
also increases by the same factor k. Moreover, if causes are added, the corresponding 
responses add. 


(a) y(t) = f(t - 2) 

(b) y(t) = /(-«) 

(c) y(t) = f(at) 



Fig. PI. 7-3 
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1.7- 4 A system is specified by its input-output relationship as 

v«- />(.)/(!) 

Show that the system satisfies the homogeneity property but not the additivity prop- 
erty. 

1.7- 5 Show that the circuit in Fig. PI. 7-5 is zero-state linear but is not zero-input linear. 

Assume all diodes to have identical (matched) characteristics. 

Hint: In zero state (when the initial capacitor voltage u c (0) = 0), the circuit is linear. 
If the input /(f) = 0, and ti c (0) is nonzero, the current j /(f) does not exhibit linearity 
with respect to its cause u c (0). 


y(0 



Fig. PI. 7-5 


1.7-6 The inductor L and the capacitor C in Fig. PI. 7-6 are nonlinear, which makes the 
circuit nonlinear. The remaining 3 elements are linear. Show that the output y(f) of 
this nonlinear circuit satisfies the linearity conditions with respect to the input /(f) 
and the initial conditions (all the initial inductor currents and capacitor voltages). 
Recognize that a current source is an open circuit when the current is zero. 


/(') 

Fig. PI. 7-6 

1.7-7 For the systems described by the equations below, with the input /(f) and output 
y(t), determine which of the systems are causal and which are noncausal. 



(a) y(f) = /(f - 2) 

(b) y(t) = /(-<) 


(c) y(t) = f(at) a > 1 

(d) y(t) = f(at) a < 1 
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1.7-8 For the systems described by the equations below, with the input /(f) and output 
y(t), determine which of the systems are invertible and which are noninvertible. For - 
the invertible systems, find the input-output relationship of the inverse system. 



(c) y(t) = /"(f) n, integer 

(d) y(f) = cos [/(f)] 


3ft 



Fig. Pl.8-1 Fig- PI-8- 2 


1.8- 1 For the circuit depicted in Fig. Pl.8-1, find the differential equations relating outputs 

yi(f) and ysff) to the input /(f). 

1.8- 2 Repeat Prob. 1.8-1 for the circuit in Fig. PI. 8-2. 



Fig. PI. 8-3 


1.8-3 Water flows into a tank at a rate of qi units/s and flows out through the outflow valve 
at a rate of qo units/s (Fig. PI. 8-3). Determine the equation relating the outflow qo 
to the input qi. The outflow rate is proportional to the head h. Thus qo — Rh where 
R is the valve resistance. Determine also the differential equation relating the head 
h to the input qi. 

(Hint: The net inflow of water in time At is (?i - qo)At. This inflow is also AAh 
where A is the cross section of the tank.) 




Time-Domain Analysis of 
Continuous-Time Systems 


In this book we consider two methods of analysis of linear time-invariant (LTI) 
systems: the time-domain method and the frequency-domain method. In this chap- 
ter we discuss the time-domain analysis of linear, time-invariant, continuous-time 
(LTIC) systems. 

2.1 Introduction 

For the purpose of analysis, we shall consider linear differential systems. 
This is the class of LTIC systems discussed in Chapter 1, for which the input f(t) 
and the output y(t) are related by linear differential equations of the form 

d n y d n ~ l y dy 

7F + an - 1 dF^ + '" + ai ^ + aoy{t) = 

, d m f d m ~ 1 f df 

m lF +bm - 1 M^ + ''’ + h di +bof ^ (2 ' la) 

where all the coefficients a* and b, are constants. Using operational notation D to 
represent d/dt, we can express this equation as 

( D n + a„_ 1 U n_1 + •••-(- a\D + ao) y(t) 

= ( b m D m + 6 m _ 1 O m " 1 + • ■ • + 6iD + b 0 ) }{t ) (2.1b) 


Q(D)y(t) = P(D)f(t) 

where the polynomials Q(D) and P(D) are 

Q(D) = D n + a n _iZ) n 1 + ■ • ■ + a\D + ao 
P(D) = b m D m + b m _ 1 D m ~ 1 + ... + b 1 D + b 0 
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(2.2a) 

(2.2b) 


2.1 Introduction 
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Theoretically the powers m and n in the above equations can take on any 
value. Practical noise considerations, however, require m < n. Noise is any un-„ 
desirable signal, natural or manmade, which interferes with the desired signals in 
the system. Some of the sources of noise are: the electromagnetic radiation from 
stars, random motion of electrons in system components, interference from nearby 
radio and television stations, transients produced by automobile ignition systems, 
fluorescent lighting, and so on. We show in Chapter 6 that a system specified by 
Eq. (2.1) behaves as an (m — n)th-order differentiator of high-frequency signals if 
m > n. Unfortunately, noise is a wideband signal containing components of all fre- 
quencies from 0 to oo. For this reason noise contains a significant amount of rapidly 
varying components with derivatives that are, consequently, very large. Therefore, 
any system specified by Eq. (2.1) in which m > n will magnify the high-frequency 
components of noise through differentiation. It is entirely possible for noise to be 
magnified so much that it swamps the desired system output even if the noise sig- 
nal at the system’s input is tolerably small. For the rest of this text we assume 
implicitly that m < n. For the sake of generality we shall assume m = n in Eq. 
( 2 . 1 ). 

In Chapter 1, we demonstrated that a system described by Eq. (2.1) is lin- 
ear.! Therefore, its response can be expressed as the sum of two components: the 
zero-input component and the zero-state component (decomposition property)-! 
Therefore, 

Total response = zero-input response + zero-state response (2.3) 

The zero-input component is the system response when the input f(t) = 0 so 
that it is the result of internal system conditions (such as energy storages, initial 
conditions) alone. It is independent of the external input /(f). In contrast, the 
zero-state component is the system response to the external input f(t) when the 
system is in zero state, meaning the absence of all internal energy storages; that is, 
all initial conditions are zero. 

!To demonstrate that any system described by Eq. (2.1) is linear, let the input fi(t) to the system 
generate the output yi(t), and another input / 2 (t) generate the output (t ) . Prom Eq. (2.1c) it 
follows that 

Q(D)yi(t) = P(D)h(t) and Q(D)y 2 (t) = P(D)f 2 (t) 

Multiplication of these equations by fci and k 2 , respectively and then adding yields 

Q(D) [k iyi (t) + k 2 y 2 (t )] = P(D) [kih{t) + fc 2 / 2 (t)] 

This equation shows that the input fci /i (t) + k 2 f 2 (t) generates the response fciyi(t) + k 2 y 2 (t). 
Therefore, the system is linear 

I We can verify readily that the system described by Eq. (2.1) has the decomposition property. 
If yo(t) is the zero-input response, then, by definition, 

Q(D)yo(t) = 0 

If y(f) is the zero-state response, then y(t) is the solution of 

Q(D)y(t) = P{D)f(t) 

subject to zero initial conditions (zero-state). The addition of these two equations yields 
Q(D) [y 0 (t)+y(t)]=P(D)f(t) 

Clearly, yo(t) + y(t) is the general solution of Eq. (2.1). 
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2.2 System Response to Internal Conditions: Zero-Input Response 

The zero-input response y 0 (t) is the solution of Eq. (2.1) when the input f(t) = 

0 so that 

Q{D)yo(t) = 0 (2.4a) 

or ' 

(D n + + • • ■ + a\D + a 0 ) y 0 (t) = 0 (2.4b) 

A solution to this equation can be obtained systematically. 1 However, we will take 
a short cut by using heuristic reasoning. Equation (2.4b) shows that a linear com- 
bination of yo(t) and its n successive derivatives is zero, not at some values of t, 
but for all t. Such a result is possible if and only if y 0 (t) and all its n successive 
derivatives are of the same form. Otherwise their sum can never add to zero for all 
values of t. We know that only an exponential function e xt has this property. So 
let us assume that 

yo(t) = ce M 

is a solution to Eq. (2.4b). Then 

Dyo(t) = ~ = c\e xt 

D n yo(t ] = ^ = c\ n e xt 
Substituting these results in Eq. (2.4b), we obtain 

c (A n T a n _iA n 1 T ■ • ■ -f aiA + ao) e xt = 0 
For a nontrivial solution of this equation, 

A n + a n — iA n 1 + ■ • ■ + aiA + ao = 0 (2.5a) 

This result means that ce xt is indeed a solution of Eq. (2.4), provided that A satisfies 
Eq. (2.5a). Note that the polynomial in Eq. (2.5a) is identical to the polynomial 
Q(D) in Eq. (2.4b), with A replacing D, Therefore, Eq. (2.5a) can be expressed as 

0(A) = 0 (2.5b) 

When Q (A) is expressed in factorized form, Eq. (2.5b) can be represented as 

Q( A) = (A - Ai)(A - A 2 ) • • • (A - A n ) = 0 (2.5c) 

Clearly, A has n solutions: Ai, A 2 , . . . , A n . Consequently, Eq. (2.4) has n possible 
solutions: cie Xlt , c 2 e Xlt , . . . , c n e Xnt , with ci, c 2 , . . . , c n as arbitrary constants. We 
can readily show that a general solution is given by the sum of these n solutions, f 
so that 

y 0 (t) = cie Alt + c 2 e A2t + • • • + c n e A "‘ (2.6) 

where cj, c 2 , . . . , c n are arbitrary constants determined by n constraints (the 
auxiliary conditions) on the solution. 

f To prove this assertion, assume that yzit), . . ., y n {t) are all solutions of Eq. (2.4). Then 
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Observe that the polynomial Q( A), which is characteristic of the system, has 
nothing to do with the input. For this reason the polynomial Q( A) is called the 
characteristic polynomial of the system. The equation 

Q(A) = 0 (2-7) 

is called the characteristic equation of the system. Equation (2.5c) clearly indi- 
cates that Ai, A 2 , . . ., A n are the roots of the characteristic equation; consequently, 
they are called the characteristic roots of the system. The terms characteristic 
values, eigenvalues, and natural frequencies are also used for characteristic 
roots.t The exponentials e Xit (i = 1,2, ...,n) in the zero-input response are the 
characteristic modes (also known as modes or natural modes) of the sys- 
tem. There is a characteristic mode for each characteristic root of the system, and 
the zero-input response is a linear combination of the characteristic modes of the 
system. 

The single most important attribute of an LTIC system is its characteristic 
modes. Characteristic modes not only determine the zero-input response but also 
play an important role in determining the zero-state response. In other words, the 
entire behavior of a system is dictated primarily by its characteristic modes. In the 
rest of this chapter we shall see the pervasive presence of characteristic modes in 
every aspect of system behavior. 

Repeated Roots 

The solution of Eq. (2.4) as given in Eq. (2.6) assumes that the n characteristic 
roots Ar, A 2 , .... A n are distinct. If there are repeated roots (same root occurring 
more than once), the form of the solution is modified slightly. By direct substitution 
we can show that the solution of the equation 

{D - \fyo{i) = 0 

is given by 

yo(t) = (ci + C 2 t)e xt 

In this case the root A repeats twice. Observe that the characteristic modes in this 
case are e xt and te xt . Continuing this pattern, we can show that for the differential 
equation 

(D - A) r yo(«) = 0 (2.8) 

the characteristic modes are e xt , te xt , t 2 e x \ . . . , t r_1 e At , and that the solution is 
y 0 (t) = (ci + c 2 t + • • • + c r t r 1 ) e xt (2-9) 

Q(D)yi(t) = 0 

Q{D)yz(t) = 0 


Q(D)y n (t) = 0 

Multiplying these equations by ci , 02 » • • • ( c n » respectively, and adding them together yields 
Q{D ) [ciyi(i) 4- C23/2(t) 4 f - c n yn(i)] = 0 

This result shows that ciyi(t) 4- C 2 J/ 2 (0 4 • • • 4- c n y n {t) is also a solution of the homogeneous 
equation (2.4). 

$ The term eigenvalue is German for characteristic value. 
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Consequently, for a system with the characteristic polynomial 

<3(A) = (A-A 1 ) r (A-A r+1 )---(A-A n ) 

the characteristic modes are e Xlt , te Xlt , t r ~ l e Xlt , e Xr+lt , e Xnt and the 
solution is 

2/o (t) = (ci -I- c 2 i + • • • + c r t r x )e Xlt + c r . + ie Ar+I ‘ + • • • + c n e Xnt 

Complex Roots 

The procedure for handling complex roots is the same as that for real roots. 
For complex roots the usual procedure leads to complex characteristic modes and 
the complex form of solution. However, it is possible to avoid the complex form 
altogether by selecting a real form of solution, as described below. 

For a real system, complex roots must occur in pairs of conjugates if the coef- 
ficients of the characteristic polynomial Q( A) are to be real. Therefore, if a + j/3 
is a characteristic root, a — j/3 must also be a characteristic root. The zero-input 
response corresponding to this pair of complex conjugate roots is 

yo(t) = Cl e (a+J '«‘ + c 2 e' a - J ‘« £ (2.10a) 

For a real system, the response y 0 (t) must also be real. This is possible only if Cj 
and c 2 are conjugates. Let 

Ci = and c 2 = |e~ J# 

This yields 

yo (t) = £ fi J« e < 0+i ' J)t + 

— £g«* j' e f(/3«+9) _j_ e -j(0t+«)j 

= ce at cos (/3t + 9) (2. 10b) 

Therefore, the zero-input response corresponding to complex conjugate roots a±j/3 
can be expressed in a complex form (2.10a) or a real form (2.10b). The latter is 
more convenient from a computational viewpoint because it avoids dealing with 
complex numbers. 

■ Example 2.1 

(a) Find yo(t), the zero-input component of the response for an LTI system described 
by the following differential equation: 

(D 2 + ZD + 2) y(t) = Df(t) 

when the initial conditions are yo(0) = 0, yo(0) = -5. Note that yo(t), being the zero-input 
component (f(t) — 0), is the solution of (D 2 + 3 D + 2)yo (t) = 0. 

The characteristic polynomial of the system is A 2 +3A+2. The characteristic equation 
of the system is therefore A 2 + 3A + 2 = (A + 1)(A + 2) = 0. The characteristic roots of the 
system are Ai = —1 and A 2 = —2, and the characteristic modes of the system are e~* and 
e“ 2t . Consequently, the zero-input component of the loop current is 

yo(t) = cie~‘ + c 2 e~ 2< (2.11a) 

To determine the arbitrary constants ci and c 2 , we differentiate Eq. (2.11a) to obtain 
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yo(t) = —c\e * — 2c 2 e 24 (2.11b) 

Setting t = 0 in Eqs. (2.11a) and (2.11b), and substituting the initial conditions j/o(0) = 0 
and yo(0) = -5 we obtain 

0 = ci + c 2 
—5 = —ci — 2c 2 

Solving these two simultaneous equations in two unknowns for ci and C 2 yields 

ci = —5, c 2 = 5 

Therefore 

yo (t) = -5e _< + 5e -2t 

This is the zero-input component of y(t) for t > 0. 

(b) Similar procedure may be followed for repeated roots. For instance, for a system 
specified by 

(. D 2 + 6D + 9) y(t) = (3D + 5 )f(t) 

let us determine yo(t), the zero-input component of the response if the initial conditions 
are yo(0) = 3 and yo(0) = —7. 

The characteristic polynomial is A 2 + 6A + 9 — (A + 3) 2 , and its characteristic roots 
are Ai = -3, A 2 = -3 (repeated roots). Consequently, the characteristic modes of the 
system are e _3t and te _3 ‘. The zero-input response, being a linear combination of the 
characteristic modes, is given by 

yo(t) = (ci + C2t)e _3 ‘ 

We can find the arbitrary constants ci and c 2 from the initial conditions yo(0) = 3 and 
y o (0) = -7 following the procedure in part (a). The reader can show that ci = 3 and 
c 2 = 2. Hence, 

yo (t) = (3 + 2t)e _3< t > 0 

(c) For the case of complex roots, let us find the zero-input response of an LTI system 
described by the equation: 

(D 2 + 4 D + 40) y(t) — (D + 2 )/(t) 

with initial conditions yo(0) = 2 and yo(0) = 16.78. 

The characteristic polynomial is A 2 + 4A + 40 = (A + 2 — j 6)(A + 2 + ,)6) . The 
characteristic roots are —2 i j 6. 1 The solution can be written either in the complex form 
(2.10a) or in the real form (2.10b). The complex form is yo (t) = cie Al ‘ + c 2 e A2 ‘, where 
Aj = -2 + j6 and A 2 = -2 - j 6. Since a = -2 and 0 = 6, the real form solution is [see 
Eq. (2.10b)] 

yo(i) = ce -2t cos (6f + 8) (2.12a) 

jThe complex conjugate roots of a second-order polynomial can be determined by using the formula 
in Sec. B.7-10 or by expressing the polynomial as a sum of two squares. The latter can be 
accomplished by completing the square with the first two terms, as shown below: 

A 2 + 4A + 40 = (A 2 + 4A + 4) + 36 = (A + 2) 2 + (6) 2 = (A + 2 — j6)(A + 2 + j6) 
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where c and 0 are arbitrary constants to be determined from the initial conditions y o (0) = 2 
and yo(0) = 16.78. Differentiation of Eq. (2.12a) yields 


yo{t) = —2ce 2t cos (6* + 0) - 6ce‘ 2t sin (6* + 0) (2.12b) 

Setting t — 0 in Eqs. (2.12a) and (2.12b), and then substituting initial conditions, we 
obtain 

2 = cc os 8 

16.78 = -2c cos 8 - 6c sin 6 

Solution of these two simultaneous equations in two unknowns c cos 8 and csin 8 yields 

c cos 8 = 2 (2.13a) 

csin 0 = -3.463 (2.13b) 

Squaring and then adding the two sides of the above equations yields 

c 2 = (2) 2 + (— 3.464) 2 = 16 =y c = 4 

Next, dividing (2.13b) by (2.13a); that is dividing csin 8 by ccos 8 yields 

tan 8 = =2^63 

and 


Therefore 


9 = tan- 1 (^3) = -f 
yo(t) — 4e -2t cos (64 - f ) 


Figure B.llc shows the plot of yo(4). U 


Q Computer Example C2.1 

Find the roots of polynomial A 2 + 4A + 40 


a=[l 4 40]; r= roots(a) 
r— 2.0000 6.0000i 

-2.0000 - 6.0000i Q 

O Computer Example C2.2 

For an LTIC system specified by the differential equation 
(D 2 + 4 D + k)y(t) = (3D + b)f(t) 

determine the zero-input component of the response if the initial conditions are y o (0) = 3, 
and yo(0) = -7 for two values of k\ (a) 3 (b) 4 (c) 40. 


(a) y0=dsolve(’D2y+4*Dy+3*y=0’,’y(0)=3’,’Dy(0)=-7 , ,’t’) 
yO = 2*exp(-3*t)+exp(-t) 

(b) y0=dsolve(’D2y+4*Dy+4*y=0’,’y(0)=3’,’Dy(0)=-7Vt’) 
yO = 3»exp(-2*t)-exp(-2t)*t 

(c) y0=dsolve( , D2y+4*Dy+40*y=0’,’y(0)=3’, , Dy(0)=-7’,’t’) 
yO * 3*exp(-2*t)*cos(6*t)-l/6*exp(-2t)»sin(6*t) Q 


A Exercise E2.1 

Find the zero-input response of an LTIC system described by (0 + 5)y(4) = f(t) if the initial 
condition is y(0) = 5. 

Answer: yo(4) = 5e -5t 4 > 0 v 

A Exercise E2.2 
Solve 

(D 2 + 20) y 0 (4) = 0 

if yo(0) = 1 and yo(0) = 4. Hint: The characteristic roots are 0 and —2. 

Answer: yo(4) = 3 — 2e -2t 4 > 0 V 
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Practical Initial Conditions and the meaning of 0~ and 0 + 

In Example 2.1 the initial conditions yo(0) and yo(0) were supplied. In practical 
problems, we must derive such conditions from the physical situation. For instance, 
in an RLC circuit, we may be given the conditions, such as initial capacitor volt- 
ages, and initial inductor currents, etc. From this information, we need to derive 
yo(0), yo(0), ■ ■ • for the desired variable as demonstrated in the next example. 

In much of our discussion, the input is assumed to start at 4 = 0, unless oth- 
erwise mentioned. Hence, 4 = 0 is the reference point. The conditions immediately 
before 4 = 0 (just before the input is applied) are the conditions at 4 = 0~, and 
those immediately after 4 = 0 (just after the input is applied) are the conditions at 
4 = 0 + (compare this with the historical time frame B.C. and A.D.). In practice, 
we are likely to know the initial conditions at 4 = 0~ rather than at 4 = 0 + . The 
two sets of conditions are generally different, although in some cases they may be 
identical. 

We are dealing with the total response y (4) , which consists of two components; 
the zero-input component yo(4) (response due to the initial conditions alone with 
f(t) = 0) and the zero-state component resulting from the input alone with all 
initial conditions zero. At 4 = 0~, the response y(4) consists solely of the zero-input 
component yo (4) because the input has not started yet. Hence the initial conditions 
on y(4) are identical to those of yo(4). Thus, y(0 _ ) = yo(0~), y(0 _ ) = yo(0”), and 
so on. Moreover, yo(t) is the response due to initial conditions alone and does not 
depend on the input f(t). Hence, application of the input at 4 = 0 does not affect 
yo(4). This means the initial conditions on yo(4) at 4 = 0“ and 0 + are identical; that 
is yo(0 _ ), yo(0 - ), are identical to yo(0 + ), yo(0 + ), •••, respectively. It is clear 
that for yo(4), there is no distinction between the initial conditions at 4 = 0", 0 
and 0 + . They are all the same. But this is not the case with the total response 
y(4), which consists of both, the zero-input and the zero-state components. Thus, 
in general, y(0 _ ) # y(0 + ), y(0~) yf y(0 + ), and so on. 

I Example 2.2 

A voltage }(t) = 10e _3t u(t) is applied at the input of the RLC circuit illustrated in 
Fig. 2.1a. Find the loop current y (4) for 4 > 0 if the initial inductor current is zero; that 
is, y(0") = 0 and the initial capacitor voltage is 5 volts; that is, vc(0“) = 5. 

The differential (loop) equation relating y(4) to f(t) was derived in Eq. (1.55) as 

(D 2 + 30 + 2)y(4) = 0/(4) 

The zero-state component of y(4) resulting from the input f(t), assuming that all initial 
conditions are zero; that is, y(0~) = uc(0~) = 0, will be obtained later in Example 2.5. In 
this example we shall find the zero-input component yo (4). For this purpose, we need two 
initial conditions yo(0) and yo(0). These conditions can be derived from the given initial 
conditions, y(0 _ ) = 0 and uc(0“) = 5, as follows. Recall that yo(4) is the loop current 
when the input terminals are shorted at 4 = 0, so that the input f(t) = 0 (zero-input) as 
depicted in Fig. 2.1b. We now compute yo(0) and yo(0), the values of the loop current and 
its derivative at 4 = 0, from the initial values of the inductor current and the capacitor 
voltage. Remember that the inductor current cannot change instantaneously in the absence 
of an impulsive voltage. Similarly, the capacitor voltage cannot change instantaneously in 
the absence of an impulsive current. Therefore, when the input terminals are shorted at 
4 = 0, the inductor current is still zero and the capacitor voltage is still 5 volts. Thus, 

yo(0) = 0 
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Fig. 2.1 


To determine i/o(0), we use the loop equation for the circuit in Fig. 2.1b. Because the 
voltage across the inductor is L(dyo/dt) or yo(t), this equation can be written as follows: 

yo(t) + 3j/o(t) + vc(t) = 0 

Setting t = 0, we obtain 

yo(0) + 3yo(0) + v c (0) = 0 (2.14) 

But t/o(0) = 0 and vc( 0) = 5. Consequently, 

yo(0) = -5 

Therefore, the desired initial conditions are 

yo(0) = 0 and yo(0) = -5 


Thus, the problem reduces to finding yo(t), the zero-input component of y(t) of the system 
specified by the equation (D 2 + 3 D + 2 )y(t) = Df(t), when the initial conditions are 
yo(0) = 0 and j)o(O) = —5. We have already solved this problem in Example 2.1a, where 
we found 

yo{t) = -5e~‘ + 5e~ 2t t> 0 (2.15) 

This is the zero-input component of the loop current y(f). 

It will be interesting to find the initial conditions at t = 0~ and 0 + for the total 
response y(t). Let us compare y( 0") and y(0~) with y(0 + ) and y(0 + ). The two pairs can 
be compared by writing the loop equation for the circuit in Fig. 2.1a at t = 0” and t = 0 + . 
The only difference between the two situations is that at t = 0~, the input f(t) = 0, 
whereas at t — 0 + , the input f(t) — 10 (because f(t) = 10e~ 3t ). Hence, the two loop 
equations are 


y(0-) + 3y(0 ) + t)c(0~) = 0 
y(0 + )+3y(0 + ) + uc(0 + ) = 10 

The loop current y(0 + ) — y(0“) — 0 because it cannot change instantaneously in the 
absence of impulsive voltage. The same is true of the capacitor voltage. Hence, vc(0 + ) = 
t>c(0~) = 5. Substituting these values in the above equations, we obtain y(0“) = -5 and 
y(0 + ) = 5. Thus 

y(0 _ ) = 0, y(0 - ) = —5 and y(0 + ) = 0, y(0+) = 5 (2.16) 


A Exercise E2.3 

In the circuit in Fig. 2.1a, the inductance L = 0 and the initial capacitor voltage vc(0) = 30 
volts. Show that the zero-input component of the loop current is given by yo(t) = — 10e -2t / 3 for 
t > 0. V 
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Independence of Zero-Input and Zero-State Response 

In this example we computed the zero-input component without using the input 
f(t). The zero-state component can be computed from the knowledge of the input 
f(t ) alone; the initial conditions are assumed to be zero (system in zero state). The 
two components of the system response (the zero-input and zero-state components) 
are independent of each other. The two worlds of zero-input response and zero-state 
response coexist side by side, neither of them knowing or caring what the other is 
doing. For each component, the other is totally irrelevant. 

Role of Auxiliary Conditions in Solution of Differential Equations 

Solution of a differential equation requires additional pieces of information (the 
auxiliary conditions). Why? We now show that a differential equation does not, 
in general, have a unique solution unless some additional constraints (or conditions) 
on the solution are known. The reason is that, as explained in the discussion on 
invertibility (Sec. 1.7), the differentiation operation is not invertible unless one piece 
of information about y(t) is given. Thus, differentiation is an irreversible (noninvert- 
ible) operation during which certain information is lost. To invert this operation, 
one piece of information about y(t) must be provided to restore the original y(t). 
Using a similar argument, we can show that, given d 2 y/dt 2 , we can determine y(f) 
uniquely only if two additional pieces of information (constraints) about y(t) are 
given. In general, to determine y(t) uniquely from its nth derivative, we need n 
additional pieces of information (constraints) about y(t). These constraints are also 
called auxiliary conditions. When these conditions are given at t = 0, they are 
called initial conditions. 

2.2-1 Some Insights into the Zero-Input Behavior of a System 

By definition, the zero-input response is the system response to its internal 
conditions, assuming that its input is zero. Understanding this phenomenon pro- 
vides interesting insight into system behavior. If a system is disturbed momentarily 
from its rest position and if the disturbance is then removed, the system will not 
come back to rest instantaneously. In general, it will come back to rest over a 
period of time and only through a special type of motion that is characteristic of 
the system. f For example, if we press on an automobile fender momentarily and 
then release it at t = 0, there is no external force on the automobile for t > 0J. 
The auto body will eventually come back to its rest (equilibrium) position, but not 
through any arbitrary motion. It must do so using only a form of response which 
is sustainable by the system on its own without any external source, because the 
input is zero. Only characteristic modes satisfy this condition. The system uses a 
proper combination of characteristic modes to come back to the rest position while 
satisfying appropriate boundary (or initial) conditions. 

If the shock absorbers of the automobile are in good condition (high damping 
coefficient), the characteristic modes will be monotonically decaying exponentials, 
and the auto body will come to rest rapidly without oscillation. In contrast, for 

f This assumes that the system will eventually come back to its original rest (or equilibrium) 
position. 

f We ignore the force of gravity, which merely causes a constant displacement of the auto body 
without affecting the other motion. 
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poor shock absorbers (low damping coefficients), the characteristic modes will be 
exponentially decaying sinusoids, and the body will come to rest through oscilla- 
tory motion. When a series RC circuit with an initial charge on the capacitor is 
shorted, the capacitor will start to discharge exponentially through the resistor. 
This response of the RC circuit is caused entirely by its internal conditions and is 
sustained by this system without the aid of any external input. The exponential 
current waveform is therefore the characteristic mode of this RC circuit. 

Mathematically we know that any combination of characteristic modes can be 
sustained by the system alone without requiring an external input. This fact can 
be readily verified for the series RL circuit shown in Fig. 2.2. The loop equation 
for this system is 

(D + 2)y(t) = f(t) 

It has a single characteristic root A = -2, and the characteristic mode is e~ 2t . We 
now verify that a loop current y(t) = ce~ 2t can be sustained through this circuit 
without any input voltage. The input voltage f(t ) required to drive a loop current 
y(t) = ce~ 2t is given by 

f(t) = L^ + Ry(t) 

== ± { ce- 2t ) + 2ce- 2t 

= —2ce~ 2t + 2ce~ 2t 
= 0 

Clearly, the loop current y(f) = ce~ 2t is sustained by the RL circuit on its own, 
without the necessity of an external input. 

The Resonance Phenomenon 

We have seen that any signal consisting of a system’s characteristic modes is 
sustained by the system on its own; the system offers no obstacle to such signals. 
Imagine what would happen if we actually drove the system with an external input 
that is one of its characteristic modes. This would be like pouring gasoline on a fire 
in a dry forest or hiring an alcoholic to taste liquor. An alcoholic would gladly do the 
job without pay. Think what will happen if he were paid by the amount of liquor he 
tasted! The system response to characteristic modes would naturally be very high. 
We call this behavior the resonance phenomenon. An intelligent discussion of 


this important phenomenon requires an understanding of the zero-state response; 
for this reason we postpone this topic until Sec. 2.7-7. 

2.3 The Unit Impulse Response h(t) 

The impulse function 5(t) is also used in determining the response of a linear 
system to an arbitrary input /(f). In Chapter 1 we explained how a system response 
to an input /(f) may be found by breaking this input into narrow rectangular 
pulses, as illustrated in Fig. 1.27a, and then summing the system response to all 
the components. The rectangular pulses become impulses in the limit as their 
widths approach zero. Therefore, the system response is the sum of its responses 
to various impulse components. This discussion shows that if we know the system 
response to an impulse input, we can determine the system response to an arbitrary 
input f(t). We now discuss a method of determining h(t), the unit impulse response 
of an LTIC system described by the nth-order differential equation 

Q{D)y{t) = P(D)/(f) (2.17a) 

where Q(D) and P(D) are the polynomials shown in Eq. (2.2). Recall that noise 
considerations restrict practical systems to m < n. Under this constraint, the most 
general case is m = n. Therefore, Eq. (2.17a) can be expressed as 

(D n + a n _i D n 1 + • • ■ + a\D + ao)y(t) = 

{b n D n + 6n-iD n_1 + • ■ • + b 1 D + b 0 )f{t) (2.17b) 

Before deriving the general expression for the unit impulse response h(t), it is 
illuminating to understand qualitatively the nature of h(t). The impulse response 
h(t) is the system response to an impulse input 5(f) applied at t = 0 with all the 
initial conditions zero at t = 0~. An impulse input 5(f) is like lightning, which 
strikes instantaneously and then vanishes. But in its wake, in that single moment, 
lightning rearranges things where it strikes. Similarly, an impulse input 5(f) appears 
momentarily at t = 0, and then it is gone forever. But in that moment it generates 
energy storages; that is, it creates nonzero initial conditions instantaneously within 
the system at f = 0 + . Although the impulse input 5(f) vanishes for f > 0 so that the 
system has no input after the impulse has been applied, the system will still have a 
response generated by these newly created initial conditions. The impulse response 
h(t), therefore, must consist of the system’s characteristic modes for f > 0 + . As a 
result 

A(f) = characteristic mode terms f > 0 + 

This response is valid for f > 0. But what happens at f = 0? At a single moment 
f = 0, there can at most be an impulse), so the form of the complete response h(t) 
is given by 

) It might be possible for the derivatives of 5(f) to appear at the origin. However, if m < n, 
it is impossible for Aft) to have any derivatives of 5(f). This conclusion follows from Eq. (2.17b) 
with fit) ~ 6(t) and y(t) — Aft). The coefficients of the impulse and all of its derivatives must 
be matched on both sides of this equation. If h(t) contains 6- 1J (t), the first derivative of 5(f), the 
left-hand side of Eq. (2.17b) will contain a term 5l n+1 )(t). But the highest-order derivative term 
on the right-hand side is 5( n )(t). Therefore, the two sides cannot match. Similar arguments can 
be made against the presence of the impulse’s higher-order derivatives in Aft). 
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h ( t ) = Ao<5(f) + characteristic mode terms t > 0 (2.18) 

The detailed derivation of h(t) is neither illuminating nor necessary for our future 
development, so to prevent needless distraction, this derivation is placed in Appen- 
dix 2.1 at the end of the chapter. There, we show that for an LTIC system specified 
by Eq. (2.17), the unit impulse response h{t) is given by 

h(t) = b n S(t) + [P(D)y n (t)}u(t) (2.19) 

where b n is the coefficient of the nth-order term in P{D) [see Eq. (2.17b)], and 

y n (t) is a linear combination of the characteristic modes of the system subject to 

the following initial conditions: 

yi n_1) ( 0) = 1, and » B (0) = y„(0) = »„(0) = • - = vi" _2) (0) = 0 (2.20) 

where yn\o) is the value of the fcth derivative of y n (i) at t = 0. We can express 
this condition for various values of n (the system order) as follows: 

n = 1 : y n (0) = 1 

n = 2 : y n (0) = 0 and y n (0) = 1 

n = 3 : y n (0) = y n (0) = 0 and y„( 0) = 1 

n = 4 : y n (0) = y n (0) = y n (0) = 0 and y n ( 0) = 1 (2.21) 

and so on. 

If the order of P(D) is less than the order of Q(D), b n = 0, and the impulse 
term b n 6(t) in h(t) is zero. 

H Example 2.3 

Determine the unit impulse response h(t) for a system specified by the equation 

(D 2 + 3D + 2) y(t) = Df(t) (2.22) 

This is a second-order system (n = 2) having the characteristic polynomial 

(A 2 + 3A + 2) = (A + 1) (A + 2) 

The characteristic roots of this system are A = — 1 and A = — 2. Therefore 

yn(t) — Cie~* + cze~ 2t (2.23a) 

Differentiation of this equation yields 

i)n(t) = -Cie~‘ - 2c 2 e~ 2t (2.23b) 

The initial conditions are [see Eq. (2.21) for n = 2] 

y„(0) = 1 and y„(0)=0 

Setting t = 0 in Eqs. (2.23a) and (2.23b), and substituting the above initial conditions, we 
obtain 

0 = Cl + C2 


1 = —Cl — 2C2 

Solution of these t'wo simultaneous equations yields 


(2.24) 
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117 


ci = 1 and c 2 — — 1 

Therefore 

y„(f) = e -t — e -2< (2.25) 

Moreover, according to Eq. (2.22), P{D) — D, so that 

P(D)y n (t) = Dy n (t) — y n (t) = -e~* + 2e -2 * 

Also in this case, b n = 62 = 0 [the second-order term is absent in P(D)]. Therefore 

h(t)^b n S(t) + [P(D)y n (t)]u(t) = {-e~ t + 2e~ 2t )u(t) ■ (2.26) 

Comment 

In the above discussion, we have assumed m < n, as specified by Eq. (2.17b). 
Appendix 2.1 shows that the expression for h(t) applicable to all possible values of 
m and n is given by 

h{t) = P(D)[y n (t)u(t)} 

where y„(t) is a linear combination of the characteristic modes of the system subject 
to initial conditions (2.20). This expression reduces to Eq. (2.19) when m < n. 

Determination of the impulse response h(t) using the procedure in this section 
is relatively simple. However, in Chapter 6 we shall discuss another, even simpler 
method using the Laplace transform. 

A Exercise E2.4 

Determine the unit impulse response of LTIC systems described by the equations: 

(a) (D + 2)y(t) = (3D + 5)/(t) 

(b) D(D + 2)y(t) = (D + 4)/(t) 

(c) (D 2 + 2D + l)y(t) = Df(t) 

Answers: (a) 36(f) — e~ 2t u(t) (b) (2 - e~ 2t )u(t) (c) (1 - t)e~‘u(t) v 

0 Computer Example C2.3 

Determine the impulse response h(t) for an LTIC system specified by the differential 
equation 

[D 2 + 3D + 2)y(t) = Df(t) 

This is a second-order system with b n = 62 = 0. First we find the zero-input component 
for initial conditions s/( 0 “) = 0 , and y( 0 ~) = 1 

Yzi=dsolve(’D2y+3*Dy+2*y=0yy(0)=0\’Dy(0)=l , , , t’) 

Yzi * -exp(-2*t)+exp(-t) 

Since P{D) = D , we differentiate the zero-input response: 

PYzi=symdiff(Yzi) 

PYzi * 2*exp(-2*t)-exp(-t) 

Therefore 

h(t) = b 2 6(t) + [Dyo(t)]u(t) — (2e~ 2t - e -t )u(£) 
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System Response to Delayed Impulse 

If h(t) is the response of an LTIC system to the input 6(f), then h{t - T) is the 
response of this same system to the input S(t — T). This conclusion follows from 
the time-invariance property of LTIC systems. Thus, by knowing the unit impulse 
response h(t), we can determine the system response to a delayed impulse 6(t - T). 

2.4 System Response to External Input: Zero-state Response 

This section is devoted to the determination of the zero-state response of an 
LTIC system. This is the system response y(t) to an input /(f) when the system 
is in zero state; that is, when all initial conditions are zero. We shall assume 
that the systems discussed in this section are in zero state unless men- 
tioned otherwise. Under these conditions, the zero-state response will be the 
total response of the system. 

We shall use the superposition principle here to derive a linear system’s re- 
sponse to some arbitrary input /(f). In this approach, we express /(f) in terms 
of impulses. We begin by approximating /(f) with narrow rectangular pulses, as 
depicted in Fig. 2.3a. This procedure gives us a staircase approximation of /(f) that 
improves as pulse width is reduced. In the limit as pulse width approaches zero, this 
representation becomes exact, and the rectangular pulses become impulses delayed 
by various amounts. The system response to the input /(f) is then given by the sum 
of the system’s responses to each (delayed) impulse component of /(f). In other 
words, we can determine y(t), the system response to any arbitrary input /(f), if 
we know the impulse response of the system. 

For the sake of generality, we place no restriction on /(f) as to where it starts 
and where it ends. It is therefore assumed to exist for all time, starting at f = -oo. 
The system’s total response to this input will then be given by the sum of its 
responses to each of these impulse components. This process is illustrated in Fig. 
2.3. 

Figure 2.3a shows /(f) as a sum of rectangular pulses, each of width At. In 
the limit as At — ► 0, each pulse approaches an impulse having a strength equal to 
the area under that pulse. For example, as At — * 0, the shaded rectangular pulse 
located at f = nAr in Fig. 2.3a will approach an impulse at the same location with 
strength /(nAr) At (the shaded area under the rectangular pulse). This impulse 
can therefore be represented by [/(nAr)Ar]<5(t - nAr), as shown in Fig. 2.3d. 

If the system’s response to a unit impulse 5(f) is h(t) (Fig. 2.3b), its response 
to a delayed impulse S(t - nAr) will be h(t - nAr) (Fig. 2.3c). Consequently, 
the system’s response to [/(nAr) Ar]£(f - n At) will be [f(nAr)Ar]h(t - nAr), as 
llustrated in Fig. 2.3d. These results can be conveniently displayed as input-output 
cairs with an arrow directed from the input to the output as shown below. The left- 
land side represents the input, and the right-hand side represents the corresponding 
system response: 


m 

S(t — nAr) 
[/(nAT)Ar)<(f - nAr) 

input 


h(t) 

hit - nAr) 

[/(nAr) Ar]h(t - nAr) 


output 


(2.27) 


9 


/{nAx)/i ( t - nAt)Ax 
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This display shows the input-output pairs in Figs. 2.3b, c, and d, respectively. The 
last pair represents the system response to only one of the impulse components 
of f(t). The total response y(t) is obtained by summing all such components as 
depicted in Fig. 2.3e. Summing on both sides of the above display yields (with 
Ar -> 0) 


CO oo 

lim /(nAr)f(t-nAr)AT =4- lim ^ f(nAr)h(t — nAr)Ar 

n—~ oo n=— oo 

' / ' V ' 

The input f(t) The output y(t) 

The left-hand side is the input f(t) represented as a sum of all the impulse compo- 
nents in a manner illustrated in Fig. 2.3a. The right-hand side is the output y(t) 
represented as a sum of the output components as shown in Fig. 2.3e. Both the 
left-hand side and the right-hand side, by definition, are integrals given byf 



fit) vW 


(2.28) 


The left-hand side expresses the input f(t) as made up of the impulse components 
in a manner depicted in Fig. 2.3a. The right-hand expresses the output as made up 
of the sum of the system responses to all the impulse components of the input as 
illustrated in Fig. 2.3e. To summarize, the (zero-state) response y(t) to the input 
f(t) is given by 



f(r)h(t - r)dr 


(2.29) 


This is the result we seek. We have obtained the system response y(t) to input 
f(t) in terms of the unit impulse response h(t). Knowing h(t), we can determine 
the response y(t ) to any input. Observe once again the all-pervasive nature of the 
system’s characteristic modes. The system response to any input is determined 
by the impulse response, which in turn is made up of characteristic modes of the 


system. 

It is important to keep in mind the assumptions used in deriving Eq. (2.29). 
We assumed a linear, time-invariant (LTI) system. Linearity allowed us to use 
the principle of superposition, and time-invariance made it possible to express the 
system’s response to 6(t — nAr) as h(t — n At). 


2.4-1 The Convolution Integral 

The zero-state response y(t) obtained in Eq. (2.29) is given by an integral 
that occurs frequently in the physical sciences, engineering, and mathematics. For 


\ In deriving this result we have assumed a time-invariant system. If the system is time-varying, 
then the system response to the input 6(t - nAr) cannot be expressed as h(t - nAr), but instead 
has the form h(t, nAr). Using this form will modify Eq. (2.28) as 

/ oo 

/(r)ft(t, r) dr (2.28n) 

-oo 

where h(t, t) is the system response at instant t to a unit impulse input located at r. 
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this reason this integral is given a special name: the convolution integral. The 
convolution integral of two functions fi(t) and /2(t) is denoted symbolically by 
/i(t) * /2ft) and is defined as 


■h(t)= r 

J —a 


/l(r)/ 2 (< - r) dr 


Some important properties of the convolution integral are given below. 

1. The Commutative Property: Convolution operation is commutative; that is, 
/i(0*/2(0 = hit)*fiit). This property can be proved by a change of variable. 
In Eq. (2.30), if we let x = t - r so that r = t — x and dr = —dx, we obtain 

/ — OO 

~ x)dx 


r — OO 

fl(t) * hit) = - / f2(x)fl(t - x) 1 
J OO 

/ oo 

hix)fiit - x)dx 

•OO 


= /2(f) * flit) 


2. The Distributive Property: According to this property: 


/i(t) * [/2(t) + /a(*)] = /i(0 * hit) + hit) * hit) (2-32) 

3. The Associative Property: According to this property: 

flit) * 1/2(0 * /3(0] = l/i(0 * hit)] * hit ) (2.33) 

The proofs of (2.32) and (2.33) follow directly from the definition of the con- 
volution integral. They are left as an exercise for the reader. 

4. The Shift Property: If 


, hit) * hit) = c(0 

then 

flit) * hit - T) = c(t - T) 
hit ~ T ) * Mt) = c(t - T) 

and 

flit - Ti) * hit - T 2 ) = c(t - Ti - T 2 ) 
Proof: We are given 


Therefore 


/ OO 

fiir)hit — t) dr = c(t) 

•OO 

/ OO 

fiir)hit — T — r) dr 

-OO 


cit-T) 


(2.34a) 

(2.34b) 

(2.34c) 


Equation (2.34b) follows from (2.34a) and the commutative property of convo- 
lution; Eq. (2.34c) follows directly from (2.34a) and (2.34b). 

5. Convolution with an Impulse: Convolution of a function f(t) with a unit 
impulse results in the function f{t) itself. By definition of convolution 
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Fig. 2.6 Convolution of f(t) and h(t) in Example 2.4. 


Because this integration is with respect to r, we can pull e 2t outside the integral, giving 
us 

y(t) — e~ 2t [ e r dr = e~ 2t (e‘ - 1) = e~‘ - e~ 2t t> 0 (2.41) 

Jo 

Also, y(t) = 0 when t < 0 [see Eq. (2.38)]. This result, along with Eq. (2.41), yields 

y(t) = (e _t - e~ 2t )u(t) (2.42) 

The response is depicted in Fig. 2.6c. B 
A Exercise E2.5 

For an LTIC system with the impulse response h(t) — 6e~ t u{t) 1 determine the system re- 
sponse to the input; (a) 2u(t.) and (b) 3e -3t u(£). 

Answer: (a) 12(1 - e -1 )u(t) (b) 9(e~‘ — e~ 3t )u(t) V 
A Exercise E2.6 

Repeat Exercise E2.5 if the input /(f) = e - *u(£). 

Answer: 6£e -t u(£) V 

The Convolution Table 

The task of convolution is considerably simplified by a ready-made convolution 
table (Table 2.1). This table, which lists several pairs of signals and their resulting 
convolution, can conveniently determine y(t), a system response to an input /(f), 
without performing the tedious job of integration. For instance, we could have 
readily found the convolution in Example 2.4 using pair 4 (with A, = — 1 and 
A 2 = -2) to be (e _t - e~ 2t )u(t). The following example demonstrates the utility of 
this table. 


2,4 System Response to External Input: The Zero-State Response 

TABLE 2.1: Convolution Table 


No /i(t) 


/a(t) Mt)*f 2 (t) = h(t)*fi(t) 


1 fit) 

2 e x ‘u(t) 


6(t - T) 
u(t) 
u(t) 


fit - T) 

1 — - e xt 

Hr u(t 

tu(t) 


4 

e Xl ‘u(t) 

e x ^u(t) 

— r— U(t) Al ^ A 2 

Ai — A 2 

5 

e xt u(t) 

e xt u(t) 

te Xt u(t ) 

6 

te x, u(t) 

e xt u(t) 

\t\ xt u(t) 

7 

t n u(t) 

e xt u(t) 

n\e xt \—> nlf’ 1- ^ 

l«+i“ (t) j+i( n -/)! u(t) 

3-0 

8 

t m u(t ) 

t n u{t) 

m\n\ jm+n+l/j) 

(m + n + 1)! W 

9 

te x,t u(t) 

e A2 *u(t) 

e X2t - e Xlt + (Ai - A 2 )te Xl ' ^ 
(Ai - A 2 ) 3 ] 

10 

t m e x ‘u(t) 

t n e xt u(t) 

m!n! t m+n+l e xt u(t) 

(n + m + 1)! 

11 

t m e Xlt u(t) 

t n e X2t u{t) 

A(-iym!(n+j)!rV“ 

A-r /!(m — j)!(Ai - A 2 ) n+ t +I 


Al / A 2 


12 e at cos {/3t + 6)u(t ) e M u(t ) 


13 e Xl ‘u(t ) 


^ (-l)»n!(m + fc)lt"-V’ t ( ] 

+ 2_. fc!(n - fc)!( A 2 -Ai) m+k + 1 

fc=0 

M (t) co S (e-4>)e xt -e- at cos i£t+±-J) 

U(t} ^/(a + A ) 2 + d 2 

4> — tan -1 [— (3/ (a + A)] 

e^u i-t) ^Mt) + ^i-t ) ReA;>ReAl 

A2 — Al 


14 


e Xlt u(—t) 


e X2t u(—t) 
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H Example 2.5 

Find the loop current y(t) of the RLC circuit in Example 2.2 for the input f(t) = 
10e“ 3t u(t), when all the initial conditions are zero. 

The loop equation for this circuit [see Example 1.11 or Eq. (1.55)] is 

(. D 2 + 3D + 2) y (t) = Df(t) 

The impulse response h(t) for this system, as obtained in Example 2.3, is 

h(t) = (2e~ 2t - e -t ) u(t) 

The input is fit) = 10e~ 34 u(t), and the response y(t) is 

y(t) = f{t) * h(t) 

= 10e~ 3t u(t) * [2e~ 2t - e"‘] u(t) 

Using the distributive property of the convolution [Eq. (2.32)], we obtain 

y(t) = 10e _3t u(t) * 2e~ 2t u[t) - 10e" 3t u(t) * e“‘u(t) 

= 20 [e~ 3 ‘u(t) * e~ 2t u(t)] - 10 [e _3t u(t) * e“*u(0] 

Now the use of Pair 4 in Table 2.1 yields 

»<*> = - e-"] ^ [e- - u( t ) 

= -20 (e~ 3< - e~ 2t ) u(t) + 5 (e~ 3t - e _t ) u(t) 

= (— 5e _t + 20e“ 2 ‘ - 15e~ 3i ) u(t) (2.43) 


A Exercise E2.7 

Rework Probs. E2.5 and E2.6 using the convolution table. V 

A Exercise E2.8 

Using the convolution table, determine 

e~ 2t u(t) * (l — u(t) 

Answer: (5 — e -t -h u(t) V 

A Exercise E2.9 

For an LTIC system with the unit impulse response h(t) = e~ 2t u(t), determine the zero-state 
response y(t) if the input /(t) = sin 3tu(t). Hint: Use the convolution table Pair 12 with suitable 
values for a 0 9, and A. 

Answer: i [3e~ 2t + \/l3 cos (3t - 146.32°)] u(t) or i [3e" 2t - v^Scos (3t + 33.68°)] u(t) v 
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Multiple Inputs 

Multiple inputs to LTI systems can be treated by applying the superposition 
principle. Each input is considered separately, with all other inputs assumed to be 
zero. The sum of all these individual system responses constitutes the total system 
output when all the inputs are applied simultaneously. 

2.4-2 Graphical Understanding of Convolution 

To have a proper grasp of convolution operation, we should understand the 
graphical interpretation of convolution. Such a comprehension also helps in evalu- 
ating the convolution integral of more complicated signals. In addition, graphical 
convolution allows us to grasp visually or mentally the convolution integral’s re- 
sult, which can be of great help in sampling, filtering, and many other problems. 
Finally, many signals have no exact mathematical description, so they can be de- 
scribed' only graphically. If two such signals are to be convolved, we have no choice 
but to perform their convolution graphically. 

We shall now explain the convolution operation by convolving the signals f{t) 
and g(t), illustrated in Figs. 2.7a and 2.7b respectively. If c{t) is the convolution of 
f{t) with g(t), then 

c(t) = f f(r)g(t - r)dr (2.44) 

J — OO 

One of the crucial points to remember here is that this integration is performed with 
respect to r, so that t is just a parameter (like a constant). This consideration is 
especially important when we sketch the graphical representations of the functions 
/(t) and g[t - r) appearing in the integrand of Eq. (2.44). Both of these functions 
should be sketched as functions of r, not of t. 

The function f(r) is identical to f{t), with r replacing t (Fig. 2.7c). Therefore, 
f{t) and /(t) will have the same graphical representations. Similar remarks apply 
to git) and g(r) (Fig. 2.7d). 

The function git - r) is not as easy to comprehend. To understand what this 
function looks like, let us start with the function g(r) (Fig. 2.7d). Time-mversion 
of this function (reflection about the vertical axis r = 0) yields g(— t) (Fig. 2.7e). 
Let us denote this function by < i>{r) 

4>{r) = g{~r) 

Now 0(r) shifted by t seconds is 0(r - t), given by 

<t> iT-t) = g[-iT-t)} = g(t-T) 

Therefore, we first time-invert g[r) to obtain g(-r) and then time-shift g(-r) by 
t to obtain g(t — r). For positive t, the shift is to the right (Fig. 2.7f); for negative 
t, the shift is to the left (Fig. 2.7g). 

The preceding discussion gives us a graphical interpretation of the functions 
fir) and g(t - r). The convolution c(t) is the area under the product of these two 
functions. Thus, to compute c(t) at some positive instant t = t j, we first obtain 
gi~ t) by inverting g (t) about the vertical axis. Next, we right-shift or delay g{— t) 
by ti to obtain g(t\ — r) (Fig. 2.7f), and then we multiply this function by /(t), 
giving us the product /(r)g(ti - r) (Fig. 2.7f). The area A \ under this product 
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is c(t 0, the value of c(<) at t = t x . We can therefore plot c(t x ) = A x on a curve 
describing c(t), as shown in Fig. 2.7i. Observe that the area under the product 
f(r)g(-T ) in Fig. 2.7e is c(0), the value of the convolution for i = 0 (at the origin). 

A similar procedure is followed in computing the value of c(t) at t = < 2 , where 
t 2 is negative (Fig. 2.7g). In this case, the function g(-r) is shifted by a negative 
amount (that is, left-shifted) to obtain s(t 2 -r). Multiplication of this function with 
}(t) yields the product f(r)g(t 2 - r). The area under this product is c(t 2 ) = A 2 , 
giving us another point on the curve c(t) at t = t 2 (Figure 2.7i). This procedure can 
be repeated for all values of t, from -oo to oo. The result will be a curve describing 
c(t) for all time t. Note that when t < -3, /(r) and g(t - t) do not overlap (see 
Fig. 2.7h); therefore, c(t) = 0 for t < -3. 

Summary of the Graphical Procedure 

The procedure for graphical convolution can be summarized as follows: 

1. Keep the function /(r) fixed. 

2. Visualize the function j(r) as a rigid wire frame, and rotate (or invert) this 
frame about the vertical axis (r = 0) to obtain g(—r). 

3. Shift the inverted frame along the r axis by t 0 seconds. The shifted frame now 
represents g{t o - t). 

4. The area under the product of /(r) and p(to - t) (the shifted frame) is c(t 0 ), 
the value of the convolution at t = to- 

5. Repeat this procedure, shifting the frame by different values (positive and 
negative) to obtain c(t) for all values of t. 



Convolution: its bark is worse than its bite! 


The graphical procedure discussed here appears very complicated and discour- 
aging at first reading. Indeed, some people claim that convolution has driven many 
electrical engineering undergraduates to contemplate theology either for salvation 
or as an alternative career ( IEEE Spectrum, March 1991, p.60). Actually, the bark 
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of convolution is worse than its bite! In graphical convolution, we need to deter- 
mine the area under the product f(r)g(t - r) for all values of f from — oo to oo. 
However, a mathematical description of /(r)g(f - r) is generally valid over a range 
of f. Therefore, repeating the procedure for every value of t amounts to repeating 
it only a few times for different ranges of t. 

We can also use the commutative property of convolution to our advantage 
by computing /(t) * g(t) or g(t) * f(t), whichever is simpler. As a rule of thumb, 
convolution computations are simplified if we choose to invert the simpler of the 
two functions. For example, if the mathematical description of g(t) is simpler than 
that of /(f), then f(t) * g(t) will be easier to compute than g(t) * f(t). In contrast, 
if the mathematical description of f(t ) is simpler, the reverse will be true. 

We shall demonstrate graphical convolution with the following examples. Let 
us start by reworking Example 2.4 using this graphical method. 

■ Example 2.6 

Determine graphically y(t) = /(f) * h(t) for /(f) = e~ t u( t) and h(t) = e~ 2t u(t). 
Figures 2.8a and 2.8b show /(f) and h(t) respectively, and Fig. 2.8c shows /(r) and 
/i(-t) as functions of r. The function h(t - r ) is now obtained by shifting h(-r) by f. If f 
is positive, the shift is to the right (delay); if f is negative, the shift is to the left (advance). 
Figure 2.8d shows that for negative f, h{t - r) [obtained by left-shifting h(-r)] does not 
overlap /(r), and the product /(r)h(f - t) — 0, so that 

y(t) =0 t < 0 

Figure 2.8e shows the situation for f > 0. Here /(t) and h(t - r) do overlap, but the 
product is nonzero only over the interval 0 < r < t (shaded interval). Therefore 

y(t) = f }{r)h(t — T)d.T t>0 

Jo 

All we need to do now is substitute correct expressions for /(r) and /i(t-r) in this integral. 
Figures 2.8a and 2.8b clearly indicate that the segments of /(f) and g(t) to be used in this 
convolution (Fig. 2 .8e) are described by 


Therefore 


Consequently 


/(f) = e~* and h(t) — e~ 


/(r) — e T and h(t - r) = e 


f -T — 2(t— r) 

Jo 

— e -2t f e r dr 

Jo 


Moreover, y(t) = 0 for f < 0, so that 


y(t) = (e * - e 2< ) u(f) ■ 
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Fig. 2.8 Convolution of /(f) and h(t) in Example 2.6. 

M Example 2.7 

Find c(t) = /(f) * g(t ) for the signals depicted in Figs. 2.9a and 2.9b. 

Since /(f) is simpler than g(t), it is easier to evaluate g(t) * f(t) than /(f) * g(t). 
However, we shall intentionally take the more difficult route and evaluate /(f) * g(t) to 
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clarify some of the finer points of convolution. 

Figures 2.9a and 2.9b show /(f) and g(t) respectively. Observe that g{t) is composed 
of two segments. As a result, it can be described as 

( 2e~‘ segment A 


Therefore 


! - r) = | 


, 2e 2(t-r) 


segment B 


segment A 
segment B 


The segment of /(f) that is used in convolution is /(f) = 1, so that /(r) = 1. Figure 2.9c 
shows /(t) and g(—r). 

To compute c(t) for t > 0, we right-shift g(-r) to obtain g(f-r), as illustrated in Fig. 
2.9d. Clearly, g(t - r) overlaps with /(r) over the shaded interval; that is, over the range 
r > 0; Segment A overlaps with /(r) over the interval (0, f), while Segment B overlaps 
with }(t) over (f, oo). Remembering that /(r) = 1, we have 


p OO 

I = / f(r)g(t - r) dr 
Jo 

= dr + J~ -2e^- T) dr 


= 2 (l - e _< ) - 1 


= 1 - 2e _t t > 0 

Figure 2.9e shows the situation for f < 0. Here the overlap is over the shaded interval; 
that is, over the range r > 0, where only the segment B of g{t) is involved. Therefore 

c(t) = j f{r)g(t-T)dr 

r oo 

= / a(t - r) dr 
Jo 

/ oo 

-2e 2(t - r) dr 


Therefore 


Figure 2.9f shows a plot of c(f). H 

■ Example 2.8 

Find /(f) * g(t) for the functions /(f) and g(t) shown in Figs. 2.10a and 2.10b. 

Here, /(f) has a simpler mathematical description than that of g(f), so it is preferable 
to invert /(f). Hence, we shall determine g(t) * /(f) rather than /(f) * g(t). Thus 

c(t) = g(t) * f{t) 


g(r)f(t-T) dr 
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First, we determine the expressions for the segments of f(t) and g(t) used in finding c(t). 
According to Figs. 2.10a and 2.10b, these segments can be expressed as 

/(f) = 1 and g(t) = 


Therefore 


»( T ) = s r 


Fig. 2.10c shows g(r) and /(— r), whereas Fig. 2.10d shows g(r) and f(t — r), which is 
/( -r) shifted by t. Because the edges of /(— r) are at r = —1 and 1, the edges of f(t — r) 
are at — 1 + t and 1 + t. The two functions overlap over the interval (0, 1 -f t) (shaded 
interval), so that 


c(t) = f 
Jo 

-f 


= ±(t + l) 2 — 1 < t < 1 (2.46a) 

This situation, depicted in Fig. 2.10d, is valid only for — 1 < t < 1. For t > 1 but < 2, 
the situation is as illustrated in Fig. 2.10e. The two functions overlap only over the range 
— 1 + ttol + t (shaded interval). Note that the expressions for g(r) and f(t - r) do not 
change; only the range of integration changes. Therefore 


Also note that the expressions in Eqs. (2.46a) and (2.46b) both apply at t = 1, the tran- 
sition point between their respective ranges. We can readily verify that both expressions 
yield a value of 2/3 at t = 1, so that e(l) = 2/3. The continuity of c(f) at transition points 
indicates a high probability of a right answer, f For t > 2 but < 4 the situation is as shown 
in Fig. 2.10f. The functions g(r) and f(t ~ r) overlap over the interval from -1 + t to 3 
(shaded interval), so that 

c(«) = [ It dr 

J-l+t 

= (t 2 - 2t-8) (2.46c) 

Again, both Eqs. (2.46b) and (2.46c) apply at the transition point t = 2. We can readily 
verify that c(2) = 4/3 when either of these expressions is used. 

For t > 4, f(t — r) has been shifted so far to the right that it no longer overlaps with 
g(r) as depicted in Fig. 2.10g. Consequently 

c(t) = 0 t > 4 (2.46d) 

We now turn our attention to negative values of t. We have already determined c(£) 
up to t = — 1. For t < — 1 there is no overlap between the two functions, as illustrated in 
Fig. 2.10h, so that 

c(t) = 0 t < -1 (2.46e) 

Figure 2.10i shows c(t) plotted according to Eqs. (2.46a) through (2.46e). I 


f Even if c(t ) is continuous at the transition, the answer could be wrong in the unlikely event of 
two or more errors canceling out their effects. Our discussion assumes that there are no impulses 
in f(t — t) and g(r) after the transition which were not present before. 








136 


2 Time-Domain Analysis of Continuous-Time Systems 



Fig. 2.11 Convolution of f(t) and g(t) in Exercise E2.ll. 



Fig. 2.12 Convolution of /(t) and g(t) in Exercise E2.12. 



Fig. 2.13 Convolution of f(t) and g(t) in Exercise E2.13. 


Width of the Convolved Function 

The widths (durations) of f{t), g(t), and c(t) in Example 2.8 (Fig. 2.10) are 
2, 3, and 5 respectively. Note that the width of c(t) in this case is the sum of the 
widths of /(f) and g{t). This observation is not a coincidence. Using the concept of 
graphical convolution, we can readily see that if /(f) and g(t) have the finite widths 
of T\ and T 2 respectively, then the width of c(t) is generally equal to Xi + T 2 . The 
reason is that the time it takes for a signal of width (duration) Ti to completely 
pass another signal of width (duration) T 2 so that they become nonoverlapping is 
X l + T 2 . When the two signals become nonoverlapping, the convolution goes to 
zero. However, there are cases where the two signals /(r) and g{t - r) overlap, yet 
the area under their product vanishes. Such is the case of signals in Fig. P2.4-14 
for r > 2ir. In this case the width property is superficially violated.) 

A Exercise E2.10 

Rework Example 2.7 by evaluating g(t) * /(f) V 
A Exercise E2.ll 

Use graphical convolution to show that f(t) * g(t) = g(t) * f(t) — c(i) in Fig. 2.11. V 
A Exercise E2.12 

Repeat Prob. E2.ll for the functions in Fig. 2.12. V 
A Exercise E2.13 

Repeat Prob. E2.ll for the functions in Fig. 2.13. V 

tEven in such cases, the width property may be held valid if we consider that the region where 
the area under the product of two nonoverlapping signals vanishes to become a part of c(t) (where 
c(i) happens to be zero). Thus, c(t ) in this case has an infinite duration, but the value of c(i) - 0 
for t > 2 ir. 
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(7) Computer Example C2.4 

Find c(t) = f(t) * g(t) for the signals in Fig. 2.9. 

tl=-10:.01:0;tl=tl’; 
gl=-2*exp(2*tl); 
t2=0:.01:10;t2=t2’; 
g2=2*exp(-t2); 
t=[tl;t2]; g=[gl;g2]i 

f=[zeros(size(gl));ones(size(g2))]; 

c=0.01*conv(f,g); 
t=-20:.01:5;t=t’; 
plot(t,c(l:length(t))) Q 

Some Reflections on the Use of Impulse Function 

In the study of signals and systems we often come across signals such as im- 
pulses, which cannot be generated in practice. One wonders why we even consider 
such signals. The answer should be clear from our discussion so far in this chapter. 
Even if the impulse function has no physical existence, we can compute the system 
response h{t) to this phantom input according to the procedure in Sec. 2.3, and 
knowing h{t), we can compute the system response to any arbitrary input. The 
concept of impulse response, therefore, provides an effective intermediary for com- 
puting system response to an arbitrary input. In addition, the impulse response ( ) 
ftself provides a great deal of information and insight about the system behavior 
In Sec 2 7 we show that the knowledge of impulse response provides much valuable 
information, such as the response time, pulse dispersion, and filtering P^°P ert ‘^ of 
the system. Many other useful insights about the system behavior can be obtained 

by inspection of h{t). . , . , 

We have a similar situation in frequency-domain analysis (discussed in late 

chapters) where we use an everlasting exponential ( or sinusoid) to determine system 
response. An everlasting exponential (or sinusoid) has no physical existence, bu 
it provides another effective intermediary for computing the system response to 
an arbitrary input. Moreover, the system response to everlasting exponential (or 
sinusoid) provides valuable information and insight regarding the system s behavior. 

2,4-3 A Very Special Function For LTI Systems: The Everlasting 
Exponential e st 

There is a very special connection of LTI systems with the everlasting expo- 
nential function e st . We now show that the LTI system’s (zero-state) response .to 
everlasting exponential input e“ is also the same everlasting exponential (w thin 
a multiplicative constant). Moreover, no other function can make the same chum. 
Such an input for which the system response is also of the same form is called th 
characteristic function (also eigenfunction) of the system. Because a sinusoid is 
a form of exponential, everlasting sinusoid is also a characteristic function of an LT 
system. Note that we are talking here of an everlasting exponential (or sinusoid), 
which starts at t = -oo. 

If h(t) is the system’s unit impulse response, then system response y(t) to an 
everlasting exponential e st is given by 
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/ OO 

h{T)e s ^- T) dr 

-OO 

r°° 

= e st / h(r)e~ ,T dr 

J — OO 


The integral on the right-hand side is a function of s. Let us denote it by H(s). 
Thusf, 

y(t) = H(s)e‘ t (2.47) 

where 


/ OO 

h(r)e~ aT dr 

-OO 


Note that H(s) is a constant for a given a. Thus, the input and the output are the 
same (within a multiplicative constant) for the everlasting exponential signal. 

H(s), which is called the transfer function of the system, is a function of 
complex variable s. We can define the transfer function H(s) of an LTIC system 
from Eq. (2.47) as 

H{s) = ° Ut P— 4-— - (2.49) 

input signal I n p U t=everlasting exponential e at 

The transfer function is defined for, and is meaningful to, LTI systems only. It does 
not exist for nonlinear or time-varying systems in general. 

In this discussion we are talking of the everlasting exponential, which starts at 
f = -oo, not the causal exponential e st u(t), which starts at f = 0. 

For a system specified by Eq. (2.1), the transfer function is given by 

*<•>- 5 $ (2 ' 50) 

This follows readily by considering an everlasting input /(f) = e 3t . According to Eq. 
(2.47), the output is y{t) = H(s)e st . Substitution of this /(f) and y(t) in Eq. (2.1) 
yields H(s)[Q(D)e at } = P{D)e 3t . Moreover, D r e st = dTe at /dt r = s r e st . Hence, 
P(D)e at = P(s)e 3t and Q(D)e at = Q{s)e st . Consequently, H{s) = P(s)/Q(s). 

A Exercise E2.14 

Show that the transfer function of an ideal integrator is H(s) — 1/s and that of an ideal 
differentiator is H(s) = s. Find the answer in two ways: using Eq. (2.49) and Eq. (2.50). V 

2.4-4 Total Response 

The total response of a linear system can be expressed as the sum of its zero- 
input and zero-state components: 

n 

Total Response = ^ Cje x ’ 1 + /(f) * Mt) 

zero-state component 


zero-input component 


fThis result is valid only for the values of s for which the h(r)e 9T dr exists (or converges). 
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Fig. 2.14 Total response and its components. 

For repeated roots, the zero-input component should be appropriately modified. 

For the series RLC circuit in Example 2.2 with the input f{t) = 10e u(t) 
and the initial conditions w (0“) = 0, t>c(0 _ ) = 5, we determined the zero-input 
component in Example 2.2 [Eq. (2.15)]. We found the zero-state component m 
Example 2.5 Using the results in Examples 2.2 and 2.5, we obtain 

Total current = (-^ + 5e~ 2t ) + (-Se" 4 + 20e' 2 ‘ - 15e" 3t )_ t > 0 (2.51a) 

■ ' 1 — ‘ 

zero-input current zero-state current 

Figure 2.14a shows the zero-input, the zero-state, and the total response. 

Natural and Forced Response 

For the RLC circuit in Example 2.2, the characteristic modes were found to 
be e -t and e~ 2t . As we expected, the zero-input response is composed exclusively 
of characteristic modes. Note, however, that even the zero-state response [Eq^ 
(2.51a)] contains characteristic mode terms. This observation is generally true of 
LTI systems. We can now lump together all the characteristic mode terms in te 
total response, giving us a component known as the natural response y n {t). T e 
remainder, consisting entirely of noncharacteristic mode terms, is known as the 
forced response y$(t). The total response of the RLC circuit in Example 2.2 can 
be expressed in terms of natural and forced components by regrouping the terms m 
Eq. (2.51a) as 

Total current = (-10e-‘ + 25e- 2t ) + (-15e~ 3t ) t>0 (2.51b) 

natural response y n (t) forced response y*(t) 

Figure 2.14b shows the natural, forced, and total response. 

2.5 Classical Solution of Differential Equations 

In the classical method we solve differential equation to find the natural and 
forced components rather than the zero-input and zero-state components of the 
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response. Although this method is relatively simple compared to the method dis- 
cussed so far, as we shall see, it also has several glaring drawbacks. 

As Sec. 2.4-4 shows, when all of the characteristic mode terms of the total sys- 
tem response are lumped together, they form the system’s natural response y n (t) 
(also known as the homogeneous solution or complementary solution). The 
remaining portion of the response consists entirely of noncharacteristic mode terms 
and is called the system’s forced response y^it) (also known as the particular 
solution). Equation (2.51b) shows these two components for the loop current in 
the RLC circuit of Fig. 2.1a. 

The total system response is y{t) = y n (t) + y<t> {t). Since y(t ) must satisfy the 
system equation [Eq. (2.1)], 

Q(D)[y n (t) + y^t)} = P(D)f(t) 
or 

Q(D)y n (t) + Q(D) n (t) = P(D)f(t) 

But y n (t) is composed entirely of characteristic modes. Therefore 

Q(D)y n (t) = 0 

so that 

Q{D) n {t) = P{D)f(t) (2.52) 

The natural response, being a linear combination of the system’s characteristic 
modes, has the same form as that of the zero-input response; only its arbitrary 
constants are different. These constants are determined from auxiliary conditions, as 
explained later. We shall now discuss a method of determining the forced response. 

2.5-1 Forced Response: The Method of Undetermined Coefficients 

It is a relatively simple task to determine y 0 (t), the forced response of an LTIC 
system, when the input /(t) is such that it yields only a finite number of independent 
derivatives. Inputs having the form e (t or t r fall into this category. For example, 
e ct has only one independent derivative; the repeated differentiation of e (t yields 
the same form as this input; that is, e ***. Similarly, the repeated differentiation of 
t r yields only r independent derivatives. The forced response to such an input can 
be expressed as a linear combination of the input and its independent derivatives. 
Consider, for example, the input at 2 + bt+c. The successive derivatives of this input 
are 2at + b and 2a. In this case, the input has only two independent derivatives. 
Therefore, the forced response can be assumed to be a linear combination of f(t) 
and its two derivatives. The suitable form for y^it) in this case is, therefore 

y<t>(i ) = 02 1 2 + 0\t + 0o 

The undetermined coefficients 0o, Pu and 02 are determined by substituting this 
expression for y^t) in Eq. (2.52) 

Q(D)v*(t) = P(D)f(t) 

and then equating coefficients of similar terms on both sides of the resulting expres- 
sion. 
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TABLE 2.2 


Input f{t) Forced Response 

1. e<‘ C^Ai(i = l, 2, •••,«) 0e Cl 

2. e<‘ C = Ai 0te <l 

3 . k P 

4. cos (ut + 6) 0 cos M + d>) 


5. (t r + a r _it r ~ * 1 + hait + ao)fi a (0 T t r + P T ~it T 1 + ■ ■ ■ + Pit 

+Po)e it 

Note: By definition, cannot have any characteristic mode terms. If 

any term appearing in the right-hand column for the forced response is also a 
characteristic mode of the system, the correct form of the forced response must be 
modified to t'y^t), where i is the smallest possible integer that can be used and still 
can prevent t'y^t) from having a characteristic mode term. For example, when the 
input is e t - t , the forced response (right-hand column) has the form pe^. But if e 
happens to be a characteristic mode of the system, the correct form of the forced 
response is 0te« (see Pair 2). If te< 1 also happens to be a characteristic mode of 
the system, the correct form of the forced response is 0 t 2 e Cf , and so on. 


Although this method can be used only for inputs with a finite number of 
derivatives, this class of inputs includes a wide variety of the most commonly en- 
countered signals in practice. Table 2.2 shows a variety of such inputs and the 
form of the forced response corresponding to each input. We shall demonstrate this 
procedure with an example. 

I Example 2.9 

Solve the differential equation 

(D 2 +3D + 2) y{t) = Df(t) 

if the input 

f(t) = t 2 + 5t + 3 

and the initial conditions are y(0 + ) = 2 and y(0 + ) = 3. 

The characteristic polynomial of the system is 

A 2 + 3A + 2 = (A + 1)(A + 2) 

Therefore, the characteristic modes are e~ t and e -2t . The natural response is then a linear 
combination of these modes, so that 

% i n {t) — Ri e * + Ahe 2t t > 0 

Here the arbitrary constants Ri and K 2 must be determined from the system’s initial 
conditions. 
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The forced response to the input t 2 + 5t + 3, according to Table 2.2 (Pair 5 with 
C = 0), is 

y*(f) = ftt 2 + Pit + Po 

Moreover, y^(t) satisfies the system equation [Eq. (2.52)]; that is, 

Now (D 2 + 3D + 2) y t {t) = Df(t) (2.53) 

D V4 ,(t) = J (Pit 2 + Pit + 0o) = 2 Pit + 0i 
D 2 y<p(t) = (pit 2 + 0i t + 0o) = 2 0i 

and 

Df(t) = ^ [t 2 + 5t + 3] =2t + 5 

Substituting these results in Eq. (2.53) yields 

20i + 3(2 Pit + 0i) + 2(0 it 2 + 0i t + 0a) = 2i + 5 
or 

20it 2 + (20i + 6 0i)t + (20o + 30i + 2 0i) = 2t + 5 
Equating coefficients of similar powers on both sides of this expression yields 

20i = O 

20i + 60i = 2 

20o + 30i +20i = 5 

Solving these three equations for their unknowns, we obtain 0 O = \, 0i = 1, and 0i = 0. 
Therefore 

y<t>(t) = t + 1 t > 0 

The total system response y(t) is the sum of the natural and forced solutions. Therefore 
y(t) = Vn(t) + ypt) 

= Are"* + Kie~ 2t + t + 1 t > 0 

so that 

y(t) = -Kie~ { - 2Kie~ 2t + 1 

Setting t = 0 and substituting y(0) = 2 and y(0) = 3 in these equations, we have 

2 — K\ + X 2 + 1 

3 = -Ki - 2 X 2 + I 

The solution of these two simultaneous equations is Ai = 4 and Ki = -3. Therefore 
y(t) = 4e~* - 3e~ 2t + t + 1 t > 0 ■ 

Comments on Initial Conditions 

In the classical method, the initial conditions are required at t = 0 + . The 
reason is that because at t = 0 _ , only the zero-input component exists, and the 
initial conditions at t = 0” can be applied to the zero-input component only. In the 
classical method, the zero-input and zero-state components cannot be separated. 
Consequently, the initial conditions must be applied to the total response, which 
begins at t = 0 + . 
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A Exercise E2.15 

An LTIC system is specified by the equation 

(. D 2 +5D + 6) y(t) = (D + 1 )f(t) 

The input is f(t) = «?. Find (a) the forced r ? ponse y,(t) (b) the total response y(t) if the 
initial conditions are y(0"^) = yg and y{ 0 ) — 3 - 

Answers: (a) w (t) = t 2 + \t - ft (b) v(t) = 8e~* - Se"* + (‘ 2 + \* ~ ») ‘ ‘ V 

The The exponent'iafsignal is the most important signal in the study of LTI systems. 
Interestingly, the forced response for an exponential input signal turns out to be 
very simp! From Table 2.2 we see that the forced response for the input e 
the form We now show that 0 = Q(C)/F(C)-t To determine the constant 0, 

we substitute y*(t) = P e (t in the system equation [Eq. (2.52)] to obtain 

Q(D) [0e (t ] = P(D)e< t ( 2 - 54 ) 

Now observe that 

De « = ± ( e <*) = Ce ct 

I>V -£(«*)-*<* 



where 


y<t>(t) = H( C)e c ‘ t > 0 


H( C) = 


P( 0 

< 3(0 


(2.55) 

(2.56) 


This is an interesting and significant result. It states that for an exponentid in- 
put e<‘ the forced response W (t) is the same exponential muUapked 
F(C)/Q(0- The total s y stem response y(t) to an exponential l p 

given by 

»(o=i>i eM+ff ( c)eCt (2 ' 57) 


f This result is valid only if C is not a characteristic root of the system. 
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where the arbitrary constants A'i, A 2 , . . K n are determined from auxiliary con- 
ditions. 

Recall that the exponential signal includes a large variety of signals, such as a 
constant (£ = 0), a sinusoid (£ = ±jw), and an exponentially growing or decaying 
sinusoid (C = <r ± ju). Let us consider the forced response for some of these cases. 

The Constant Input f(t) = C 

Because C = Ce ot , the constant input is a special case of the exponential input 
Ce^ 1 with C = 0. The forced response to this input is then given by 

y<l>{t) = CH(C)e ft with C = 0 

= CH( 0) (2.58) 

The Exponential Input e J '“ t 
Here ( — ju and 

y*(t) = H(ju>)e jwt (2.59) 

The Sinusoidal Input f(t) = cos u 0 t 

We know that the forced response for the input is H (±jui)e ±iut . Since 

cos o/i = (e Jwt -I- e _Jwt )/2, the forced response to cos cut is 

!/*« = 5 [H (M*** + 

Because the two terms on the right-hand side are conjugates, 

V*(0 = Re [HtiuW" 1 ] 

But 

H(ju) = \H(ju>)\e> iH M 

so that 

!/*(<) = Re 

= \H (ja))| cos [ut + (2.60) 

This result can be generalized for the input f(t ) = cos(u>t + 0). The forced response 
in this case is 

— | H (ju)\ cos [ut + 9 + lH(jw)\ (2-61) 

■ Example 2.10 

Solve the differential equation 

(D 2 + 3D + 2) y(t) = Df(t) 

if the initial conditions are y(0 + ) = 2 and y(0 + ) = 3 and the input is 

(a) 10e -31 (b) 5 (c) e~ 2t (d) 10 cos (3t + 30°). 

According to Example 2.9, the natural response for this case is 
y„(t) = Are - * + A 2 e~ 2t 
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= 10H(-3)e- 3t = 10 [ ( _ 3)2 + 3 (_3 ) + 2 ] e~ 3t = * > 0 

The total solution (the sum of the forced and the natural response) is 
y(t) = Are"* + A 2 e~ 2t - 15e“ 31 t > 0 


y(t) = — Aie _t - 2A 2 e~ 2t + 45e 3t t > 0 

The initial conditions are 1/(0*) = 2 and y( 0*) — 3. Setting t — 0 in the above equations 
and then substituting the initial conditions yields 

Ai + A 2 - 15 = 2 and - Ai - 2A 2 + 45 = 3 

Solution of these equations yields Ai = -8 and A 2 = 25- Therefore 

y(t) = -8e~* + 25e~ 2t - 15e~ 3 * t > 0 

(b) For input f(t) = 5 = 5e°\ C = 0, and 

y*(t) = 5A(0) = 0 t > 0 

The complete solution is Aje -t 4- A 2 e -2f . Using the initial conditions, we determine K\ 
and A 2 as in part (a). 

(c) Here £ = -2, which is also a characteristic root of the system. Hence, (see Pair 
2, Table 2.2, or the comment at the bottom of the table) 

y*(t) = 0 te~ 2t 

To find 0, we substitute y*(t) in the system equation to obtain 

(D 2 + 3D + 2) y*(t) = Df{t) 
or 

(D 2 + 3D + 2) [0 te~ 2t ] = De _2t 

But 


D [0te~ 2t ] = 0(1 - 2 t)e~ 2t 
D 2 [0te~ 2t ] = 40 (t - l)e“ 2 * 
De -2t = — 2e -2t 

Consequently 

0(4t - 4 + 3 - 6t + 2t )e _2t = -2e~ 2t 


Therefore, 0 = 2 so that 


—0e~ 2t = -2e~ 2t 


146 


2 Time-Domain Analysis of Continuous-Time Systems 


y*(t) = 2 te“ 2t 

The complete solution is ATie - * + A 2 e~ 2t + 2te~ 2 ‘. Using the initial conditions, we deter- 
mine K\ and K 2 as in part (a). 

(d) For the input f(t) = 10 cos (3t + 30°), the forced response [see Eq. (2.61)] is 
W(t) = 10|J?0’3)| cos [3 1 + 30° + lH(jZ)] 

where 


- PtJV _ J'3 _ j’3 27 — j'21 

Q(j 3) (j3) 2 + 3(j3) + 2 -7 + j’9 130 

Therefore 


o.263e _: > 37!! ° 


I H03)| = 0.263, lH(jZ) = -37.9° 

and 

y*(t) = 10(0.263) cos (3t + 30° -37.9°) = 2.63 cos (3< - 7.9°) 

The complete solution is Kie~ t -I- A 2 e“ 2t -I- 2.63 cos (3t — 7.9°). Using the initial conditions, 
we determine K i and K 2 as in part (a). B 


■ Example 2.11 

Using the classical method, find the loop current y(t) in the RLC circuit of Fig. 2.1, 
Example 2.2 if the input voltage f(t) = 10e _3 ‘ and the initial conditions are y(0~) - 0 
and uc(0~) = 5. 

The zero-input and zero-state responses for this problem are found in Examples 2.2 
and 2.5, respectively. The natural and forced responses appear in Eq. 2.51b. Here we shall 
solve this problem by the classical method, which requires the initial conditions at t = 0 + . 
These conditions, already found in Eq. (2.16), are 

y(0 + ) = 0 and y(0 + ) = 5 

The loop equation for this system [see Example 2.2 or Eq. (1.55)] is 
(D 2 + 3D + 2) y(t) = Df{t) 

The characteristic polynomial is A 2 + 3A + 2 = (A + 1)(A + 2). Therefore, the natural 
response is 

y n (t) = Kie~ l + K 2 e~ 2t 

The forced response, already found in Example 2.10(a), is 


The total response is 


y*(t) = — 15e“ 3 * 

1/(0 = Are - * + A 2 e~ 2t - 15e“ 3t 


Differentiation of this equation yields 


y(t) = -Are -1 - 2 K 2 e~ 2t + 45e" 3 ‘ 


Setting t = 0 + and substituting y(0 + ) = 0, y(0 + ) = 5 in these equations yields 


0 =K i + A 2 - 15 
5 = — Ki — 2A 2 -t- 45 


K i = - 10 
A 2 =25 


2.6 System Stability 
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Therefore 

y(t) = -10e“‘ + 25e _2< - 15e~ 3t 

which agrees with the solution found previously in Eq. 2.51b. I 

Q Computer Example C2.5 
Solve the differential equation 

(D 2 + 3D + 2 )y{t) = fit) 

for the input /(t) = 5i + 3. 
f=’5*t+3’i 
mpa(’f’,f) 

yt=dsolve(’D2y+3*Dy-(-2*y=f’.’y(0)=2 , , , Dy(0)=3 , ,’t’) 
yt ■ -9/4+5/2»t-19/4*exp(-2»t)+9*exp(-t) © 

Assessment of the Classical Method 

The development in this section shows that the classical method is relatively 
simple compared to the method of finding the response as a sum of the zero-input 
and zero-state components. Unfortunately, the classical method has a serious draw- 
back because it yields the total response, which cannot be separated into compo- 
nents arising from the internal conditions and the external input. In the study of 
systems it is important to be able to express the system response to an input / it) as 
an explicit function of fit). This is not possible in the classical method. Moreover, 
the classical method is restricted to a certain class of inputs; it cannot be applied 
to any input. Another minor problem is that because the classical method yields 
total response, the auxiliary conditions must be on the total response which exists 
only for t > 0 + . In practice we are most likely to know the conditions at t = 0” 
(before the input is applied). Therefore, we need to derive a new set of auxiliary 
conditions at t = 0 + from the known conditions at t = 0 _ . 

If we must solve a particular linear differential equation or find a response of 
a particular LTI system, the classical method may be the best. In the theoretical 
study of linear systems, however, the classical method is practically useless. 

2.6 System Stability 

Because of the great variety of possible system behaviors, there are several 
definitions of stability in the literature. Here we shall consider a definition that is 
suitable for causal, linear, time-invariant (LTI) systems. 

In order to understand system stability intuitively, let us examine the stability 
concept as applied to a right circular cone. Such a cone can be made to stand 
forever on its circular base, on its apex, or on its side. For this reason these three 
states of the cone are said to be equilibrium states. Qualitatively, however, the 
three states show very different behavior. If this cone, standing on its circular base, 
were to be disturbed slightly, it would eventually return to its original equilibrium 
state if left to itself. In this case, the cone is said to be in stable equilibrium. 
In contrast, if the cone stands on its apex, then the slightest disturbance will cause 
the cone to move farther and farther away from its equilibrium state. The cone in 
this case is said to be in an unstable equilibrium. The cone lying on its side, if 
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disturbed, will neither go back to the original state nor continue to move farther 
away from the original state. The cone in this case is said to be in a neutral 
equilibrium. 

Let us apply these observations to systems in general. If, in the absence of an 
external input, a system remains in a particular state (or condition) indefinitely, 
then that state is said to be an equilibrium state of the system. For an LTI 
system this equilibrium state is the zero state, in which all initial conditions are 
zero. Now suppose an LTI system is in equilibrium (zero state) and we change this 
state by creating some nonzero initial conditions. By analogy with the cone, if the 
system is stable it should eventually return to zero state. In other words, when left 
to itself, the system’s output due to the nonzero initial conditions should approach 
0 as f — * oo. But the system output generated by initial conditions (zero-input 
response) is made up of its characteristic modes. For this reason we define stability 
as follows: a system is (asymptotically) stable if, and only if, all its characteristic 
modes — > 0 as t — > oo. If any of the modes grows without bound as t — * oo, the 
system is unstable. There is also a borderline situation in which the zero-input 
response remains bounded (approaches neither zero nor infinity), approaching a 
constant or oscillating with a constant amplitude as t -> oo. For this borderline 
situation, the system is said to be marginally stable or just stable. 

If an LTIC system has n distinct characteristic roots Ai, A 2 , . . ., A n , the zero- 
input response is given by 

n 

Vo(t) = J2 c i eX,t (2.62) 

t=i 

We have shown elsewhere [see Eq. (B.14)] 


lim e xt = 

t— » OO 


0 

00 


Re A < 0 
Re A > 0 


(2.63) 


It is helpful to study system stability in terms of the location of the system’s charac- 
teristic roots in the complex plane. Let us first assume that the system has distinct 
roots only. If a characteristic root A is located in the left half of the complex plane 
(LHP), its real part is negative (Re A < 0). Similarly, if a root A is located in the 
right half of the complex plane (RHP), its real part is positive (Re A > 0). Along 
the imaginary axis, the real part is zero (Re A = 0). These regions are delineated in 
Fig. 2.15. Equation (2.63) clearly shows that the characteristic modes correspond- 
ing to roots in LHP vanish as t — * 00 , while the modes corresponding to roots in 
RHP grow without bound as t — > 00 . However, the modes corresponding to simple 
(unrepeated) roots on the imaginary axis are of the form e j0t ; these are bounded 
(neither vanish nor grow without limit) as t — > 00 . 

From this discussion it follows that a system is asymptotically stable if, and 
only if, all of its characteristic roots lie in the left half of the complex plane. If any 
of the roots — even one — lies in RHP, the system is unstable. If none of the roots lie 
in RHP, but if some unrepeated (simple) roots lie on the imaginary axis, then the 
system is marginally stable (Fig. 2.15). 

So far we have assumed all of the system’s n roots to be distinct. The modes 
corresponding to a root A repeated r times are e xt ,te xt ,t 2 e xt , ■ ■ ■ , t r ~ 1 e xt . But as 


r 
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Fig. 2.15 Characteristic roots location and system stability. 

t — ► 00 , t k e xt -> 0, if Re A < 0 (A in LHP). Therefore, repeated roots in LHP 
do not cause instability. But when the repeated roots are on the imaginary axis 
(A = ju > ), the corresponding modes t k e joit approach infinity as t ->■ 00 . Therefore, 
repeated roots on the imaginary axis cause instability Figure 2.16 shows character- 
istic modes corresponding to characteristic roots at various location in the complex 
plane. Observe the central role played by the characteristic roots or characteristic 
modes in determining the system’s stability. 

To summarize: 

1. An LTIC system is asymptotically stable if, and only if, all the characteristic 
roots are in the LHP. The roots may be simple (unrepeated) or repeated. 

2. An LTIC system is unstable if, and only if, either one or both of the following 
conditions exist: (i) at least one root is in the RHP, (ii) there are repeated 
roots on the imaginary axis. 

3. An LTIC system is marginally stable if, and only if, there are no roots in the 
RHP, and there are some unrepeated roots on the imaginary axis. 

I Example 2.12 

Investigate the stability of LTIC system described by the following equations: 

(a) (D + 1) (D 2 + 4£> + 8) y(t) = (D - 3)f(t) 

(b) (D - 1) (D 2 + 4D + 8) y(t) = (D + 2)/(t) 

(c) (D + 2)(D 2 + 4)y(t) = (D 2 + D + l) f(t) 

(d) (D + 1 )(D 2 + 4) 2 y(t) = (D 2 + 2D + 8) f(t) 
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Fig. 2.16 Location of characteristic roots and the corresponding characteristic modes. 


The characteristic polynomials of these systems are 

(a) (A +- 1) (A 2 + 4A + 8) = (A + 1)(A + 2 - j 2)(A + 2 + j2) 

(b) (A - 1) (A 2 + 4A + 8) = (A - 1)(A + 2 - j2)(A + 2 + j 2) 

(c) (A + 2)(A 2 + 4) = (A + 2)(A — j2)(A + j2) 

(d) (A 4- 1)(A 2 + 4) 2 = (A + 2)(A - j2) 2 (A + j2) 2 
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Consequently, the characteristic roots of the systems above are (see Fig. 2.17): 

(a) - 1 , —2 ± j2 (b) 1 , —2 ± j2 (c) -2, ±j2 (d) - 1 , ±j2, ±j2. 

System (a) is asymptotically stable (all roots in LHP), (b) is unstable (one root in 
RHP), (c) is marginally stable (unrepeated roots on imaginary axis) and no roots in RHP, 
and (d) is unstable (repeated roots on the imaginary axis). ■ 



(a) (b) (c) ( d ) 

Fig. 2.17 Location of characteristic roots for systems in Example 2.12. 


A Exercise E2.16 

For each of the systems specified by the equations below, plot its characteristic roots in the 
complex plane and determine whether it is asymptotically stable, marginally stable, or unstable. 

(a) D(D + 2)y(t) = 3f(t) 

(b) D 2 (D + 3)y(t) = (D + 5)/(t) 

(c) (D + 1)(£> + 2 )y(t) = (2D + 3 )f(t) 

(d) (D 2 + 1)(Z> 2 + 9)y(t) = ( D 2 + 20 + 4) fit) 

(e) (O + 1) (O 2 — 40 + 9) y(t) — (D + 7)/(t) 

Answer: (a) marginally stable (b) unstable (c) stable (d) marginally stable (e) unstable. V 


2.6-1 System Response to Bounded Inputs 

From the example of the right circular cone, it appears that when a system is 
in stable equilibrium, application of a small force (input) produces a small response. 
In contrast, when the system is in unstable equilibrium, a small force (input) pro- 
duces an unbounded response. Intuitively we feel that every bounded input should 
produce a bounded response in a stable system, whereas in an unstable system this 
would not be the case. We shall now verify this hunch and show that it is indeed 
true. 

Recall that for an LTIC system 


Therefore 


y(t) = h(t) * /(t) 


/ OO 

h{r)f{t - T ) dr 

-OO 

/ OO 

\h(r)\\f{t - T)\dr 

-OO 


(2.64) 


Moreover, if /(t) is bounded, then | f{t - r)| < Ki < oo, and 


l»(OI < 



dr 
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Because h(t) contains terms of the form e A A or t k e Xjt , h(t) decays exponentially 
with time if Re Xj < 0. Consequently, for an asymptotically stable systemf 

\h(r)\dT < A " 2 < oo (2.65) 

|y (*)1 < K1K2 < 00 

Thus, for an asymptotically stable system, a bounded input always produces a 
bounded output. Moreover, we can show that for an unstable or a marginally 
stable system, the output y(t) is unbounded for some bounded input (see Problem 
2.6-4). These results lead to the formulation of an alternative definition of stability 
known as bounded-input, bounded-output (BIBO) stability: a system is 
BIBO stable if, and only if, a bounded input produces a bounded output. Observe 
that an asymptotically stable system is always BIBO stable.): However, a marginally 
stable system is BIBO unstable. 

Implications of Stability 

All practical signal processing systems must be stable. Unstable systems are 
useless from the viewpoint of signal processing because any set of intended or un- 
intended initial conditions leads to an unbounded response that either destroys the 
system or (more likely) leads it to some saturation conditions that change the na- 
ture of the system. Even if the discernible initial conditions are zero, stray voltages 
or thermal noise signals generated within the system will act as initial conditions. 
Because of exponential growth, a stray signal, no matter how small, will eventually 
cause an unbounded output in an unstable system. 

Marginally stable systems do have one important application in the oscillator, 
which is a system that generates a signal on its own without the application of an 
external input. Consequently, the oscillator output is a zero-input response. If such 
a response is to be a sinusoid of frequency u>o, the system should be marginally 
stable with characteristic roots at ±j ug. Thus, to design an oscillator of frequency 
wo, we should pick a system with the characteristic polynomial (A - ju>o)(A + jw 0 ) = 
A 2 + wo 2 . A system described by the differential equation 

(D 2 + w 0 2 ) y(t) = f(t) 

will do the job. 

f This can be shown as follows. If \i = an + j(3 t> then e Xit = e a ' t e j P it and |e A * t | = e ait . 
Therefore 

f |e Air u(r)| dr = f e aiT dr = — — ifReAt = aj<0 

7—00 Jo ai 

and Eq. (2.65) follows. This conclusion is also valid when the integrand is of the form |t fc e Ait |u(f). 
| However, a BIBO stable system is not necessarily asymptotically stable because BIBO stability 
is determined from the system’s impulse response, which is an external description of the system, 
while asymptotic stability is determined from the internal description of the system obtained 
from system equations. In certain systems (e.g., uncontrollable or unobservable systems), the two 
descriptions may not be the same. Remember that the external description describes only that 
part of the system which is coupled to both the input and the output. Hence, a system may be 
internally unstable while appearing stable from the system’s external terminals (BIBO stable) 2 . 
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CONIGUO 


Intuition can cut the math jungle instantly! 


2.7 Intuitive Insights into System Behavior 

This section attempts to provide an understanding of what determines system 
behavior. Because of its intuitive nature, the following discussion will be more or 
less qualitative. We shall now show that the most important attributes of a system 
are its characteristic roots or characteristic modes because they determine not only 
the zero-input response but also the entire behavior of the system. 

2.7-1 Dependence of System Behavior on Characteristic Modes 

Recall that the zero-input response of a system consists of the system’s charac- 
teristic modes. For a stable system, these characteristic modes decay exponentially 
and eventually vanish. This behavior may give the impression that these modes 
do not substantially affect system behavior in general and system response in par- 
ticular. This impression is totally wrong! We shall now see that the system’s 
characteristic modes leave their imprint on every aspect of the system behavior. 
We may compare the system’s characteristic modes (or roots) to a seed which even- 
tually dissolves in the ground; however, the plant that springs from it is totally 
determined by the seed. The imprint of the seed exists on every cell of the plant. 

In order to understand this interesting phenomenon, recall that the character- 
istic modes of a system are very special to that system because it can sustain these 
signals without the application of an external input. In other words, the system 
offers a free ride and ready access to these signals. Now imagine what would happen 
if we actually drove the system with an input having the form of a characteristic 
mode! We would expect the system to respond strongly (this is, in fact, the res- 
onance phenomenon discussed later in this section). If the input is not exactly a 
characteristic mode but is close to such a mode, we would still expect the system 
response to be strong. However, if the input is very different from any of the char- 
acteristic modes, we would expect the system to respond poorly. We shall now show 
that these intuitive deductions are indeed true. 
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Although we have devised a measure of similarity of signals (correlation) later 
in Chapter 3. we shall take a simpler approach here. Let us restrict the system’s 
inputs only to exponentials of the form e^ 4 , where ( is generally a complex number. 
The similarity of two exponential signals e (t and e xt will then be measured by the 
closeness of C and A. If the difference C - A is small, the signals are similar; if < - A 
is large, the signals are dissimilar. 

Now consider a first-order system with a single characteristic mode e xt and 
the input e r,t . The impulse response of this system is then given by Ae xt , where 
the exact value of A is not important for this qualitative discussion. The system 
response y(t) is given by 

y(t) = h(t) * /(f) 

= Ae xt u(t) * e l ' t u(f) 

From the convolution table (Table 2.1), we obtain 

y(t) = -4r [e« - e xt ] «(*) (2.66) 

^ — A 

Clearly, if the input e c * is similar to e xt , ( - A is small, and the system response is 
large. The closer the input f(t) is to the characteristic mode, the stronger is the 
system response. In contrast, if the input is very different from the natural mode, 

£ - A is large, and the system responds poorly. This is precisely what we set out to 
prove. 

We have proved the above assertion for a single-mode (first-order) system. It 
can be generalized to an nth-order system, which has n characteristic modes. The 
impulse response h(t) of such a system is a linear combination of its n modes. 
Therefore, if /(f) is similar to any one of the modes, the corresponding response 
will be high; if it is similar to none of the modes, the response will be small. Clearly, 
the characteristic modes are very influential in determining system response to a 
given input. 

It would be tempting to conclude on the basis of Eq. (2.66) that if the input 
is identical to the characteristic mode, so that £ = A, then the response goes to 
infinity. Remember, however, that if C = A, the numerator on the right-hand side 
of Eq. (2.66) also goes to zero. We shall study this complex behavior (resonance 
phenomenon) later in this section. 

We shall now show that mere inspection of the impulse response h{t) (which is 
composed of characteristic modes), reveals a great deal about the system behavior. 

2.7-2 Response Time of a System: The System Time Constant 

Like human beings, systems have a certain response time. In other words, when 
an input (stimulus) is applied to a system, a certain amount of time elapses before 
the system fully responds to that input. This time lag or response time is called 
the system time constant. As we shall see, a system’s time constant is equal to 
the width of its impulse response h(t). 

An input S(t) to a system is instantaneous (zero duration), but its response 
h(t) has a duration Th- Therefore, the system requires a time T/, to respond fully to 
this input, and we are justified in viewing Th as the system’s response time or time 
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constant. We arrive at the same conclusion via another argument. The output is 
a convolution of the input with h(t). If an input is a pulse of width T/, then the 
output pulse width is T f + T h according to the width property of convolution. This 
conclusion shows that the system requires T h seconds to respond fully to any input- 
The system time constant indicates how fast the system is. A system with a smaller 
time constant is a faster system that responds quickly to an input. A system with 
a relatively large time constant is a sluggish system that cannot respond well to 
rapidly varying signals. 

Strictly speaking, the duration of the impulse response h(t) is oo because the 
characteristic modes approach zero asymptotically as t -* oo. However, beyond 
some value of t, h(t) becomes negligible. It is therefore necessary to use some 
suitable measure of the impulse response’s effective width. 


L / T \ 

: / 

1(0 




0 


r H 1 — 


Fig. 2.18 Effective duration of an impulse response. 


There is no single satisfactory definition of effective signal duration (or width) 
applicable to every situation. For the situation depicted in Fig. 2.18, a reasonable 
definition of the duration h(t) would be T h , the width of the rectangular pulse 
hit). This rectangular pulse h(t) has an area identical to that of h(t) and a height 
identical to that of h(t) at some suitable instant t = to- In Fig. 2.18, to is chosen 
as the instant at which h(t) is maximum. According to this definition,) 


/ OO 

h{t) dt 

-oo 


Ho h (t)dt 


Now if a system has a single mode 


h(t) = Ae xt u(t) 

with A negative and real, then h{t) is maximum at t = 0 with value h{ 0) = A. 
Therefore, according to Eq. (2.67) 


_ i r 

A Jo 


Ae xt dt — — — 

A 


t This definition is satisfactory when h(t) is a single, mostly positive (or mostly negative) pulse 
Such systems are lowpass systems. This definition should not be applied indiscriminately to al 
systems. 
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Fig. 2.19 Rise time of a system. 


Thus, the time constant in this case is simply (the negative of the) reciprocal of the 
system’s characteristic root. For the multimode case, h(t) is a weighted sum of the 
system’s characteristic modes, and Th is a weighted average of the time constants 
associated with the n modes of the system. 

2.7- 3 Time Constant and Rise Time of a System 

The system time constant may also be viewed from a different perspective. 
The unit step response y(t) of a system is the convolution of u(t) with h(t). Let 
the impulse response h{t) be a rectangular pulse of width Th, as shown in Fig. 
2.19. This assumption simplifies the discussion, yet gives satisfactory results for 
qualitative discussion. The result of this convolution is illustrated in Fig. 2.19. 
Note that the output does not rise from zero to a final value instantaneously as the 
input rises; instead, the output takes Th seconds to accomplish this. Hence, the rise 
time T r of the system is equal to the system time constant 

T r = T h (2.69) 

This result and Fig. 2.19 show clearly that a system generally does not respond to 
an input instantaneously. Instead, it takes time Th for the system to respond fully. 

2.7- 4 Time Constant and Filtering 

A larger time constant implies a sluggish system because the system takes a 
longer time to respond fully to an input. Such a system cannot respond effectively 
to rapid variations in the input. In contrast, a smaller time constant indicates that 
a system is capable of responding to rapid variations in the input. Thus, there is a 
direct connection between a system’s time constant and its filtering properties. 

Consider a high-frequency sinusoid that varies rapidly with time. A system 
with a large time constant will not be able to respond well to this input. There- 
fore, such a system will suppress rapidly varying (high-frequency) sinusoids and 
other high-frequency signals, thereby acting as a lowpass filter (a filter allowing the 
transmission of low-frequency signals only). We shall now show that a system with 
a time constant Th acts as a lowpass filter having a cutoff frequency of F c = 1/Th 
Hz, so that sinusoids with frequencies below F c Hz are transmitted reasonably well, 
while those with frequencies above F c Hz are suppressed. 

To demonstrate this fact, let us determine the system response to a sinusoidal 
input /(f) by convolving this input with the effective impulse response h(t) in Fig. 
2.20a. Figures 2.20b and 2.20c show the process of convolution of h(t) with the 


I Because of varying definitions of rise time, the reader may find different results in the literature. 
The qualitative and intuitive nature of this discussion should always be kept in mind. 
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Fig. 2.20 Time constant and filtering. 

sinusoidal inputs of two different frequencies. The sinusoid in Fig. 2.20b has a 
relatively high frequency, while the frequency of the sinusoid in Fig. 2.20c is low. 
Recall that the convolution of /(f) and h(t) is equal to the area under the product 
f(r)h(t - r). This area is shown shaded in Figs. 2.20b and 2.20c for the two cases. 
For the high-frequency sinusoid, it is clear from Fig. 2.20b that the area under 
}(r)h(t - r) is very small because its positive and negative areas nearly cancel 
each other out. In this case the output y{t) remains periodic but has a rather 
small amplitude. This happens when the period of the sinusoid is much smaller 
than the system time-constant Th- In contrast, for the low-frequency sinusoid, the 
period of the sinusoid is larger than Th, so that the partial cancellation of area 
under /(r)/i(f — r) is less effective. Consequently, the output y(f) is much larger, 
as depicted in Fig. 2.20c. 

Between these two possible extremes in system behavior, a transition point 
occurs when the period of the sinusoid is equal to the system time constant Th- 
The frequency at which this transition occurs is known as the cutoff frequency 
F c of the system. Because Th is the period of cutoff frequency F c , 

K ^ (2-70) 

Th 

The frequency F c is also known as the bandwidth of the system because the system 
transmits or passes sinusoidal components with frequencies below F c while atten- 
uating components with frequencies above F c - Of course, the transition in system 
behavior is gradual. There is no dramatic change in system behavior at F c = 1/2V 
Moreover, these results are based on an idealized (rectangular pulse) impulse re- 
sponse; in practice these results will vary somewhat, depending on the exact shape 
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of h(t). Remember that the “feel” of general system behavior is more important 
than exact system response for this qualitative discussion. 

Since the system time constant is equal to its rise time, we have 



(2.71a) 


Thus, a system’s bandwidth is inversely proportional to its rise time. Although Eq. 
(2.71a) was derived for an idealized (rectangular) impulse response, its implications 
are valid for lowpass LTIC systems in general. For a general case, we can show 
that 1 


*•« = jr (2.71b) 

where the exact value of k depends on the nature of hit). An experienced engineer 
often can estimate quickly the bandwidth of an unknown system by simply observing 
the system response to a step input on an oscilloscope. 


2.7-5 Time Constant and Pulse Dispersion (Spreading) 

In general, the transmission of a pulse through a system causes pulse disper- 
sion (or spreading). Therefore, the output pulse is generally wider than the input 
pulse. This system behavior can have serious consequences in communication sys- 
tems where information is transmitted by pulse amplitudes. Dispersion (or spread- 
ing) causes interference or overlap with neighboring pulses, thereby distorting pulse 
amplitudes and introducing errors in the received information. 

Earlier we saw that if an input f(t) is a pulse of width Tf, then T y , the width 
of the output y ( t ), is 


T y = Tf + T h (2.72) 

This result shows that an input pulse spreads out (disperses) as it passes through 
a system. Since Th is also the system’s time constant or rise time, the amount of 
spread in the pulse is equal to the time constant (or rise time) of the system. 


2.7-6 Time Constant and Rate of Information Transmission 

In pulse communications systems where information is conveyed through pulse 
amplitudes, the rate of information transmission is proportional to the rate of pulse 
transmission. We shall demonstrate that to avoid the destruction of information 
caused by dispersion of pulses during their transmission through the channel (trans- 
mission medium), the rate of information transmission should not exceed the band- 
width of the communications channel. 

Since an input pulse spreads out by Th seconds, the consecutive pulses should 
be spaced T/, seconds apart in order to avoid interference between pulses. Thus, the 
rate of pulse transmission should not exceed 1/Th pulses/second. But 1/Th = T c , 
the channel’s bandwidth, so that we can transmit pulses through a communications 
channel at a rate of T c pulses/second and still avoid significant interference between 
the pulses. The rate of information transmission is therefore proportional to the 
channel’s bandwidth (or to the reciprocal of its time constant).!. 


T Theoretically, a channel of bandwidth T c _ can transmit up to 2 T c pulse amplitudes per second 
correctly. 3 Our derivation here, being very simple and qualitative, yields only half the theoretical 
limit. In practice it is difficult to attain the upper theoretical limit; transmission rates of J- c pulses 
per second are more common. 
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This discussion (Secs. 2.7-2 through 2.7-6) shows that the system time constant 
determines much of a system’s behavior — its filtering characteristics, rise time, pulse 
dispersion, and so on. In turn, the time constant is determined by the system’s 
characteristic roots. Clearly the characteristic roots and their relative amounts in 
the impulse response h{t) determine the behavior of a system. 

2.7-7 The Resonance Phenomenon 

Finally, we come to the fascinating phenomenon of resonance. As we have 
mentioned already several times, this phenomenon is observed when the input signal 
is identical or is very similar to a characteristic mode of the system. For the sake 
of simplicity and clarity, we consider a first-order system which has only a single 
mode, e Xt . Let the impulse response of this system bef 

h(t) = Ae xt (2.73) 

and let the input be 

f(t) = e (A " e)t 

The system response y(t) is then given by 

y(t) = Ae xt * e (A - e)t 
From the convolution table we obtain 

y(t) = j [e At - e< A - £ >‘] 



Now, as e — > 0, both the numerator and the denominator of the term in the paren- 
theses approach zero. Applying L’Hopital’s rule to this term yields 

lira y(t) = Ate xt (2.75) 

e — +0 

Clearly, the response does not go to infinity as t -* 0, but it acquires a factor t, 
which approaches oo as t — ► oo. If A has a negative real part (so that it lies in LHP), 
e xt decays faster than t and y(t) — > 0 as t — > oo. The resonance phenomenon in 
this case is present, but its manifestation is aborted by the signal’s own exponential 
decay. 

This discussion shows that resonance is a cumulative phenomenon, not instan- 
taneous. It builds up linearly! with t. When the mode decays exponentially, the 
signal decays at a rate too fast for resonance to counteract the decay; as a result, 
the signal vanishes before resonance has a chance to build it up. However, if the 
mode were to decay at a rate less than 1/t, we should see the resonance phenomenon 
clearly. This specific condition would be possible if Re A > 0. For instance, when 
Re A = 0, so that A lies on the imaginary axis of the complex plane, and therefore 

f For convenience we omit multiplying f(t) and h(t) by u(t). Throughout this discussion, we 
assume that they are causal. 

I If the characteristic root in question repeats r times, resonance effect increases as t r ~ l . However, 
t r ~ 1 e > ' t — > 0 as t — * - oo for any value of r, provided Re A < 0 (A in LHP). 


160 


2 Time-Domain Analysis of Continuous-Time Systems 


2.8 Determining the Impulse Response 


161 


A = ju 

and Eq. (2.75) becomes 

y{t) = Ate jajt (2.76) 

Here, the response does go to infinity linearly with t. 

For a real system, if A = ju is a root, A* = -ju must also be a root; the 
impulse response is of the form Ae ju,t + Ae~ jtJt = 2A cos ut. The response of 
this system to input A cos ut is 2 A cos ut * cos ut. The reader can show that this 
convolution contains a term of the form At cos ut. The resonance phenomenon is 
clearly visible. The system response to its characteristic mode increases linearly 
with time, eventually reaching oo, as indicated in Fig. 2.21. 



Recall that when A = ju, the system is marginally stable. As we have in- 
dicated, the full effect of resonance cannot be seen for an asymptotically stable 
system; only in a marginally stable system does the resonance phenomenon boost 
the system’s response to infinity when the system’s input is a characteristic mode. 
But even in an asymptotically stable system, we see a manifestation of resonance if 
its characteristic roots are close to the imaginary axis, so that Re A is very small. 
We can show that when the characteristic roots of a system are a ± jug, then, the 
system response to the input e- ,w ° t or the sinusoid cos ugt is very large for small 
a . f The response drops off rapidly as the input signal frequency moves away from 
uq. This frequency-selective behavior can be studied more profitably after an un- 
derstanding of frequency-domain analysis is acquired. For this reason we postpone 
full discussion of this subject until Chapter 7. 


amounts to applying a periodic force to the bridge. If the frequency of this input 
force happens to be nearer to a characteristic root of the bridge, the bridge may 
respond (vibrate) violently and collapse, even though it would have been strong 
enough to carry many soldiers marching out of step. A case in point is the Tacoma 
Narrow Bridge failure of 1940. This bridge was opened to traffic in July 1940. 
Within four months of opening (on 7 November 1940), it collapsed in a mild gale, 
not because of the wind’s brute force but because the frequency of wind-generated 
vortices, which matched the natural frequency (characteristic roots) of the bridge, 
causing resonance. 

Because of the great damage which may occur, mechanical resonance is gener- 
ally something to be avoided, especially in structures or vibrating mechanisms. If 
an engine with periodic force (such as piston motion) is mounted on a platform, the 
platform with its mass and springs should be designed so that their characteristic 
roots are not close to the engine’s frequency of vibration. Proper design of this 
platform can not only avoid resonance, but also attenuate vibrations if the system 
roots are placed far away from the frequency of vibration. 


2.8 Appendix 2.1: Determining the Impulse Response 

We now derive the unit impulse response of an LTIC system S specified by the 
nth-order differential equation 

or Q(D)y(t) = P(D)f(t) (2.77a) 

( D n 4- a n _i D n 1 -I- • • ■ + ajZ) -f ao )y{t) 

= (b n D n + fen-iD"- 1 + • • • + b x D + b 0 )f(t) (2.77b) 

In Sec. 2.3 we showed that the impulse response h(f) is given by 

h(t) = Ag6(t) + characteristic modes (2.78) 

We now show that in the above equation Ao = b n where b n is the coefficient of the 
nth-order term on the right-hand side of Eq. (2.77b). When the input f(t) = 6(t), 
the response y(t) = h(t). Therefore, from Eq. (2.77b), we obtain 

(D n + a n -\D n 1 + * ■ • + a\D + ao)h(t) = [b n D n + b n —iD n 1 + • ■ • + b\D -f- bg)S{t) 


Importance of the Resonance Phenomenon 

The resonance phenomenon is very important because it allows us to design 
frequency-selective systems by choosing their characteristic roots properly. Low- 
pass, bandpass, highpass, and bandstop filters are all examples of frequency selec- 
tive networks. In mechanical systems, the inadvertent presence of resonance can 
cause signals of such tremendous magnitudes that the system may fall apart. A 
musical note (periodic vibrations) of proper frequency can shatter a glass if the 
frequency is matched to the characteristic root of the glass, which acts as a me- 
chanical system. Similarly, a company of soldiers marching in step across a bridge 


In this equation we substitute h(t) from Eq. (2.78) and compare the coefficients of 
similar impulsive terms on both sides. The highest order of the derivative of impulse 
on both sides is n, with its coefficient value as Ao on the left-hand side and b n on 
the right-hand side. The two values must be matched. Therefore, Ao = b n and 

h(t) = b n S(t) + characteristic modes (2.79) 

To determine the characteristic mode terms in the above equation, let us consider 
a system So whose input f(t) and the corresponding output x(t) are related by 


(This follows directly from Eq. (2.74) with A = a 4- jug and e = a 


Q(D)x(t) = f{t) 


(2.80) 
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Observe that both the systems S and So have the same characteristic polynomial; 
namely, Q(A), and, consequently, the same characteristic modes. Moreover, So is 
the same as S with P(D) = 1, that is, b n = 0. Therefore, according to Eq. (2.79), 
the impulse response of So consists of characteristic mode terms only without an 
impulse at t = 0. Let us denote this impulse response of So by y n (t). Observe 
that y n ( t ) consists of characteristic modes of S, and therefore may be viewed as a 
zero-input response of S. Now t/ n (t) is the response of So to input S(t). Therefore, 
according to Eq. (2.80) 

Q(D)y n (t) = 5(t) (2.81a) 

or 

(D n + a n _ 1 D"" 1 + • • • + ai D + a 0 )y n (t) = S(t) (2.81b) 

or 

2/i n) W + a»-i!4 n_1) W + • • • + ail/JiVW + a 0 y„(t) = 6(t) (2.81c) 

where yn\t) represents the fcth derivative of y n (t). The right-hand side contains a 
single impulse term 6(t). This is possible only if i/i n_1 \f) has a unit jump disconti- 
nuity at t = 0, so that y^\t) -S(t). Moreover, the lower-order terms can not have 
any jump discontinuity because this would mean the presence of the derivatives of 
<S(t). Suppose, for instance, y n (t) has a jump discontinuity, then its derivative y n (t) 
contains an impulse 5(t), and its second derivative y n (t) contains the first derivative 
of the impulse <5(i), and so on. But this is impossible because the right-hand side of 
Eq. (2.81c) consists of only 6(t). For this reason only (t) can have a unit jump 
discontinuity so that y ( n\t) is S(t). There can be no jump discontinuities in any 
of the remaining variables because this would give rise to higher-order derivatives 
of 5(t) on the left-hand side. Therefore y„(0) = yn\0) = ■ ■ • = J/i" 2) (0) = 0 (no 
discontinuity at t = 0). Therefore, the n initial conditions on y n (t) are 

vir'H 0) = 1 

Vn (0) = v^(0) = • • • = 2/' n - 2) (0) = o (2.82) 

This discussion means that y„(t) is the zero- input response of the system S subject 
to initial conditions (2.82). 

We now show that for the same input f(t) to both systems, S and So, their 
respective outputs y(t) and x(t) are related by 

y(t) = P(D)x(t) (2.83) 

To prove this result, we operate on both sides of Eq. (2.80) by P(D) to obtain 
Q(D)P(D)x(t) = P(D)f(t) 

Comparison of this equation with Eq. (2.77a) leads immediately to Eq. (2.83). 

Now if the input /(f) = S(t), the output of S 0 is y n {t), and the output of 
S, according to Eq. (2.83), is P(D)y n {t). This output is h(t), the unit impulse 
response of S. Note, however, that because it is an impulse response of a causal 
system So, the function y n (t) is causal. To incorporate this fact we must represent 
this function as y n (t)u{t). Now it follows that h{t), the unit impulse response of 
the system S, is given by 

h(t) = P(D)[y n (t)u(t)\ (2.84) 

where y n ( t ) is a linear combination of the characteristic modes of the system subject 
to initial conditions (2.82). 


The right-hand side of Eq. (2.84) is a linear combination of the derivatives of 
y„(t)u(t). Evaluating these derivatives is clumsy and inconvenient because of the 
presence of u(t). The derivatives will generate an impulse and its derivatives at the 
origin. Fortunately when m < n [Eq. (2.77)], we can avoid this difficulty by using 
the observation in Eq. (2.79), which asserts that at t = 0 (the origin), h(t) = b n 6(t). 
Therefore, we need not bother to find h(t) at the origin. This simplification means 
that instead of deriving P(D)[y n (t)u(t ) |, we can derive P(D)y n (t) and add to it the 
term b n S(t), so that 

h(t) = M(t) + P(D)y n (t) f>0 

= b n 6(t) + [P(D)y n (t)}u(t) (2.85) 

This expression is valid when m < n [the form given in Eq. (2.77b)]. When m > n, 
Eq. (2.84) should be used. 

2.9 Summary 

This chapter discusses time-domain analysis of LTIC systems. The total re- 
sponse of a linear system is a sum of the zero-input response and zero-state response. 
The zero-input response is the system response generated only by the internal con- 
ditions (initial conditions) of the system, assuming that the external input is zero; 
hence the term “zero-input.” The zero-state response is the system response gen- 
erated by the external input, assuming that all initial conditions are zero; that is, 
when the system is in zero state. 

Every system can sustain certain forms of response on its own with no external 
input (zero input). These forms are intrinsic characteristics of the system; that 
is, they do not depend on any external input. For this reason they are called 
characteristic modes of the system. Needless to say, the zero-input response is 
made up of characteristic modes chosen in a suitable combination so as to satisfy 
the initial conditions of the system. For an nth-order system, there are n distinct 
modes. 

The unit impulse function is an idealized mathematical model of a signal that 
cannot be generated in practice. Nevertheless, introduction of such a signal as an 
intermediary is very helpful in analysis of signals and systems. The unit impulse 
response of a system is a combination of the characteristic modes of the system) 
because the impulse 6(f) = 0 for t > 0. Therefore, the system response for t > 0 
must necessarily be a zero-input response, which, as seen earlier, is a combination 
of characteristic modes. 

The zero-state response (response due to external input) of a linear system can 
be obtained by breaking the input into simpler components and then adding the 
responses to all the components. In this chapter we represent an arbitrary input 
/(f) as a sum of narrow rectangular pulses [staircase approximation of /(f)]. In the 
limit as the pulse width — > 0, the rectangular pulse components approach impulses. 
Knowing the impulse response of the system, we can find the system response to 
all the impulse components and add them to yield the system response to the input 


| There is the possibility of an impulse in addition to characteristic modes. 
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f(t). The sum of the responses to the impulse components is in the form of an 
integral, known as the convolution integral. The system response is obtained as the 
convolution of the input f(t) with the system’s impulse response h(t). Therefore, 
the knowledge of the system’s impulse response allows us to determine the system 
response to any arbitrary input. 

LTIC systems have a very special relationship to the everlasting exponential 
signal e st because the response of an LTIC system to such an input signal is the 
same signal within a multiplicative constant. The response of an LTIC system to 
the everlasting exponential input e st is H(a)e st , where H(s) is the transfer function 
of the system. 

Differential equations of LTIC systems can also be solved by the classical 
method, where the response is obtained as a sum of natural and forced response. 
These are not the same as the zero-input and zero-state components, although they 
satisfy the same equations respectively. Although simple, this method suffers from 
the fact that it is applicable to a restricted class of input signals, and the system 
response cannot be expressed as an explicit function of the input. This limitation 
makes it useless in the theoretical study of systems. 

A linear system is in a zero state if all initial conditions are zero. A system in 
a zero state is incapable of generating any response in the absence of an external 
input. When some initial conditions are applied to a system, then, if the system 
eventually goes to zero state in the absence of any external input, the system is said 
to be asymptotically stable. In contrast, if the system’s response increases without 
bound, it is unstable. If neither the system goes to zero state nor the response 
increases indefinitely, the system is marginally stable. The stability criterion in 
terms of the location of a system’s characteristic roots can be summarized as follows: 

1. An LTIC system is asymptotically stable if, and only if, all the characteristic 
roots are in the LHP. The roots may be repeated or unrepeated. 

2. An LTIC system is unstable if, and only if, either one or both of the following 
conditions exist: (i) at least one root is in the RHP; (ii) there are repeated 
roots on the imaginary axis. 

3. An LTIC system is marginally stable if, and only if, there are no roots in the 
RHP, and there are some unrepeated roots on the imaginary axis. 

According to an alternative definition of stability — bounded-input bounded- 
output (BIBO) stability— a system is stable if every bounded input produces a 
bounded output. Otherwise the system is (BIBO) unstable. Asymptotically stable 
system is always BIBO-stable. The converse is not necessarily true, however. 

Characteristic behavior of a system is extremely important because it deter- 
mines not only the system response to internal conditions (zero-input behavior), 
but also the system response to external inputs (zero-state behavior) and the sys- 
tem stability. The system response to external inputs is determined by the impulse 
response, which itself is made up of characteristic modes. The width of the impulse 
response is called the time constant of the system, which indicates how fast the 
system can respond to an input. The time constant plays an important role in de- 
termining such diverse system behavior as the response time and filtering properties 
of the system, dispersion of pulses, and the rate of pulse transmission through the 
system. 
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Problems 

2.2- 1 An LTIC system is specified by the equation 

(U 2 + 5D + 6) y(t) — (D + l)/(t) 

(a) Find the characteristic polynomial, characteristic equation, characteristic roots, 
and characteristic inodes of this system. 

(b) Find yo{t), the zero-input component of the response y(t) for t > 0, if the initial 
conditions are yo(0) — 2 and yo(0) = — 1. 

2.2- 2 Repeat Prob. 2.2-1 if 

(D 2 + 4D + 4) y(t) = Df(t) 

and yo(0) = 3, yo(0) = -4. 

2.2- 3 Repeat Prob. 2.2-1 if 

D(D + l)y(t) = (D + 2)f(t) 

and yo(0) = yo(0) = 1. 

2.2- 4 Repeat Prob. 2.2-1 if 

(D 2 + 9) y{t) = (3D + 2)/(t) 

and J/ O (0) = 0, yo(0) = 6. 

2.2- 5 Repeat Prob. 2.2-1 if 

(D 2 + 4 D + 13) y(t) = 4 (D + 2 )f(t) 

with yo(0) = 5, yo(0) = 15.98. 

2.2- 6 Repeat Prob. 2.2-1 if 

D 2 (D + l)y(t) = {D 2 + 2)/(t) 
with y o (0) = 4, i) o (0) = 3 and yo(0) = -1. 

2.2- 7 Repeat Prob. 2.2-1 if 

( D + 1) (D 2 +5D + 6) y(t ) = Df(t) 

with yo(0) = 2, yo(0) = -1 and yo(0) = 5. 

2.3- 1 Find the unit impulse response of a system specified by the equation 

(D 2 + 4D + 3) y(t) = (D + 5)f(t) 

2.3- 2 Repeat Prob. 2.3-1 if 

(D 2 + 5D + 6) y(t) = (D 2 +7D + ll) f(t) 

2.3- 3 Repeat Prob. 2.3-1 for the first-order allpass filter specified by the equation 

(D + l)»(t) = -(£>- l)/(t) 

2.3- 4 Find the unit impulse response of an LTIC system specified by the equation 

(D 2 + 6D + 9) y(t) = (2D + 9)/(t) 
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.4-1 If c(f) = f(t) * g(t ), then show that A c = A/A g , where A/, A g , and A c are the areas 
under /(£), g(t), and c(£), respectively. Verify this area property of convolution in 
Examples 2.6 and 2.8. 

.4-2 If f(t) * <?(£) = c(t), then show that f(at) * g(at) = |£|c(a£). This time-scaling 
property of convolution states that if both f(t) and p(t) are time-scaled by a, their 
convolution is also time-scaled by a (and multiplied by |l/a|). 

.4-3 Show that the convolution of an odd and an even function is an odd function and the 
convolution of two odd or two even functions is an even function. 

Hint: Use time-scaling property of convolution in Problem 2.4-2. 

.4-4 Using direct integration, find e~ at u(t) * e -f>t u(£). 

.4-5 Using direct integration, find u(t) * u(t), e~ at u(t) * e -at u(<), and tu(t) * u(£). 

.4-6 Using direct integration, find sin t u(t) * u(£) and cos tu(t) * u(t ). 

.4-7 The unit impulse response of an LTIC system is h(t) = e~ l u(t). Find this system’s 
(zero-state) response y(t) if the input f(t) is: 

(a) u(t) (b) e“ t u(£) (c) e~ 2t u(t) (d) sin 3 tu(t). 

Use the convolution table to find your answers. 

.4-8 Repeat Prob. 2.4-7 if 

h(t) = [ 2 e~ 3t - e~ 2t ] u(f) 

and if the input /(f) is: (a) u(t) (b) e~ l u(t) (c) e _ 2 t u(f) . 

.4-9 Repeat Prob. 2.4-7 if 

h(t) = (1 - 2 f)e _ 2 ‘u(f) 

and if the input /(f) = u(t). 

4-10 Repeat Prob. 2.4-7 if h(t) = 4e~ 2t cos 3 tu(t) and if the input /(f) is: (a) u(f) (b) 
e~ l u(t) . 

4-11 Repeat Prob. 2.4-7 if 

h(t) = e _t u(f) 

and if the input /(t) is: (a) e~ 2t u(t) (b) e _ 2 ^ _ 3 ^u(f) (c) e~ 2t u{t — 3) (d) the 

gate pulse depicted in Fig. P2.4-11. For (d), sketch y(t). 



fU) 

sin t 

* (0 


1 
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2n t — ► 


Fig. P2.4-15 


2.4-12 A first-order allpass filter impulse response is given by 

h{t) = -6(t) + 2e~ t u(t) 

(a) Find the zero-state response of this filter for the input e‘u(-t). 

(b) Sketch the input and the corresponding zero-state response. 

2.4- 13 Sketch the functions /(f) = and u(f). Now find f(t)*u(t) and sketch the result. 

2.4- 14 Figure P2.4-14 shows /(f) and g(t). Find and sketch c(f) = /(f) * ff(f). 

2.4- 15 Find and sketch c(f) = /(t) * git) for the functions depicted in Fig. P2.4-15. 

2.4- 16 Find and sketch c(f) = /i(f)« / 2 (f) for the pairs of functions illustrated in Fig. P2.4-16. 

2.4- 17 For an LTIC system, if the (zero-state) response to an input /(f) is y(t), show that 

the (zero-state) response to the input /(f) is y(t) and that for the input J_ oo /(r) dr 

is flee y( T ) dT - 

Hint: Recognize that /(f) = limr^o 5 = [/(f) - /(f - T)]. Now use linearity and time 
invariance to find the response to / (t). Also, recognize that J ^ /(r) dr = 

2.4- 18 If /(f) * g(t) = c(f), then show that 

/(f) *s(t) = /W = o(t) 


Hint: The input in (d) can be expressed as u(t) - u(f - 1). For parts (c) and (d), 
use the shift property (2.34) of convolution. (Alternatively, you may want to invoke 
the system’s time-invariance and superposition properties.) 


/( 0 


Extend this result to show that 

/ (r '>>(t)»g<" ) (f) = c (m+n) (t) 

where i (m) (t) is the mth derivative of x(t), and all the derivatives of /(t) and g(t) in 
this integral exist. 

Hint: Use the first part of the hint in Prob. 2.4-17 and the time-shift property of 
convolution. 

2.4-19 As mentioned in Chapter 1 (Fig. 1.27b), it is possible to express an input in terms of 
its step components, as shown in Fig. P2.4-19. If 5 (f) is the unit step response of an 
LTIC system, show that the (zero-state) response y{t) of the system to an input /(f) 
can be expressed as 


Fig. P2.4-11 
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2.4- 21 

2.5- 1 

2.5- 2 

2.5- 3 

2.5- 4 

2.5- 5 

2.0-1 



Fig. P2.4-19 

Coulomb’s law, the electric field E(r ) at a distance r from a charge q is given by 

Determine H(s ), the transfer function of an ideal time delay of T seconds. Find your 
answer by two methods; using Eq. (2.48) and using Eq. (2.49). 

Using the classical method, solve 

(D 2 + ID + 12) y(t) = (D + 2)f(t) 

if the initial conditions axe y(0 + ) = 0, ji(0 + ) = 1, and if the input f(t) is: 

(a) u(t) (b) e“*u(t) (c) e~ 2, u(t). 

Using the classical method, solve 

(D 2 + 6 D + 25) y(t) = (D + 3)/(t) 

if the initial conditions are y( 0 + ) = 0, y(0 + ) = 2, and if the input f(t) = u(t). 

Using the classical method, solve 

(D 2 + 4D + i) y(t) = (D + l)/(t) 

if the initial conditions are y(0 + ) = |, y(0 + ) = 5, and if the input f(t) is: 

(a) e -3t u(t) (b) e~ t u(t). 

Using the classical method, solve 

(D 2 + 2D)y(t) = (D + l)f(t) 

if the initial conditions are y(0 + ) = 2, y( 0 + ) = 1, and if the input is f(t) — u(t). 
Repeat Prob. 2.5-1 if the input 

}{t) = e~ 3t u(t ) 

Explain, with reasons, whether the LTIC systems described by the following equations 
are asymptotically stable, marginally stable, or unstable. 

(a) (D 2 + 8D + 12)y(t) = (D-l)f(t) 

(b) D(D 2 + 3 D + 2 )y(t) = (D + 5 )/(t) 

(c) D 2 (D 2 + 2)y(t) = f(t) 

(d) {D + 1 ){D 2 -6 D + 5)y{t) = {3D + l)/(t) 
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!.6-2 Repeat Prob. 2.6-1 if 

(a)(D + l)(D 2 + 2D + 5) 2 y(t) = f(i) 

(b )(D + 1 )(D 2 + 9 )y(t) = (2D + 9)f(t) 

(c )(D + 1 )(D 2 + 9fy(t) = (2D + 9 )/(t) 

(d)(D 2 + 1)(D 2 + 4)(D 2 + 9)y(t) = 3 Df(t) 

5.6- 3 For a certain LTIC system, the impulse response h(t) = u(t). 

(a) Determine the characteristic root(s) of this system. 

(b) Is this system asymptotically or marginally stable, or is it unstable? 

(c) Is this system BIBO stable? 

(d) What can this system be used for? 

5.6- 4 In Sec. 2.6 we demonstrated that for an LTIC system, Condition (2.65) is sufficient 

for BIBO stability. Show that this is also a necessary condition for BIBO stability 
in such systems. In other words, show that if Eq. (2.65) is not satisfied, then there 
exists a bounded input that produces an unbounded output. 

Hint: Assume that a system exists for which h(t) violates Eq. (2.65) and yet produces 
an output that is bounded for every bounded input. Establish contradiction in this 
statement by considering an input f(t) defined by f(ti — r) = 1 when h(r) > 0 and 
f(t i — r) = — 1 when h(r) < 0, where t\ is some fixed instant. 



Fig. P2.T-1 


Data at a rate of 1 million pulses per second are to be transmitted over a certain 
communications channel. The unit step response g(t) for this channel is shown in 
Fig. P2.T-1. 

(a) Explain if this channel can transmit data at the required rate. 

(b) Can an audio signal consisting of components with frequencies up to 15kHz be 
transmitted over this channel with reasonable fidelity? 

A certain communication channel has a bandwidth of 10 kHz. A pulse of 0.5 ms 
duration is transmitted over this channel. 

(a) Determine the width (duration) of the received pulse. 

(b) Find the maximum rate at which these pulses can be transmitted over this channel 
without interference between the successive pulses. 

A first-order LTIC system has a characteristic root A = — 10 4 . 

(a) Determine T r , the rise time of its unit step input response. 

(b) Determine the bandwidth of this system. 

(c) Determine the rate at which the information pulses can be transmitted through 
this system. 


2.7-2 


2.7-3 



Signal Representation By 
Fourier Series 


This chapter is important for basic understanding of signal representation and 
signal comparison, In Chapter 2 we expressed an arbitrary input f(t) as a sum of 
its impulse components. The LTI system (zero-state) response to input f(t) was 
obtained by summing the system’s responses to all these components in the form 
of the convolution integral. There are infinite possible ways of expressing an input 
f(t) in terms of other signals. For this reason, the problem of signal representation 
in terms of a set of signals is very important in the study of signals and systems. 
This chapter addresses the issue of representing a signal as a sum of its components. 
The problem is similar to that of representing a vector in terms of its components. 

Signals and Vectors 

There is a perfect analogy between signals and vectors; the analogy is so strong 
that the term ‘analogy’ understates the reality. Signals are not just like vectors. 
Signals are vectors! A vector can be represented as a sum of its components in a 
variety of ways, depending upon the choice of coordinate system. A signal can also 
be represented as a sum of its components in a variety of ways. Let us begin with 
some basic vector concepts and then apply these concepts to signals. 

3.1-1 Component of a Vector 

A vector is specified by its magnitude and its direction. We shall denote all 
vectors by boldface. For example, x is a certain vector with magnitude or length 
|x[. For the two vectors f and x shown in Fig. 3.1, we define their dot (inner or 
scalar) product as 

f -x= |f||x| cos e (3.1) 

where 9 is the angle between these vectors. Using this definition we can express |x|, 
the length of a vector x as 
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|x| 2 = x • x (3-2) 

Let the component of f along x be cx as depicted in Fig. 3.1. Geometrically 
the component of f along x is the projection of f on x, and is obtained by drawing 
a perpendicular from the tip of f on the vector x, as illustrated in Fig. 3.1. What 
is the mathematical significance of a component of a vector along another vector? 
As seen from Fig. 3.1, the vector f can be expressed in terms of vector x as 



Fig. 3.1 Component (projection) of a vector along another vector. 

f = cx + e (3-3) 

However, this is not the only way to express f in terms of x. Figure 3.2 shows two 
of the infinite other possibilities. From Figs. 3.2a and 3.2b, we have 

f = cix + ei = c 2 x + e 2 ( 3 ' 4 ) 

In each of these three representations f is represented in terms of x plus another 
vector called the error vector. If we approximate f by cx, 

f ~ cx (3-5) 

the error in the approximation is the vector e = f - cx. Similarly, the errors in 
approximations in Figs. 3.2a and 3.2b are e x and e 2 . What is unique about the 
approximation in Fig. 3.1 is that the error vector is the smallest. We can now 
define mathematically the component of a vector f along vector x to be cx where c 
is chosen to minimize the length of the error vector e — f — cx. 



Fig. 3.2 Approximation of a vector in terms of another vector. 


Now, the length of the component of f along x is |f| cos 9. But it is also c|x| as seen 
from Fig. 3.1. Therefore 

c|x| = |f| cos 9 


3.1 Signals and Vectors 

Multiplying both sides by |x| yields 

c|x| 2 = ]f||x| cos d = f • x 


Therefore 


c= = 7-r . j f x 

■v . v rvl* 


x x |x| 2 

From Fig. 3.1, it is apparent that when f and x are perpendicular, or orthogonal, 
then f has a zero component along x; consequently, c = 0. Keeping an eye on Eq. 
(3.6), we therefore define f and x to be orthogonal if the inner (scalar or dot) 
product of the two vectors is zero, that is, if 

f • x = 0 (3.7) 

3.1-2 Component of a Signal 

The concept of a vector component and orthogonality can be extended to sig- 
nals. Consider the problem of approximating a real signal /(t) in terms of another 
real signal x(t) over an interval [ti, t 2 ]: 

f{t)xzcx(t) ti<t<t 2 (3-8) 

The error e(t) in this approximation is 

f/W-c.M «,<<<<, 

I 0 otherwise 

We now select some criterion for the ‘best approximation’. We know that the signal 
energy is one possible measure of a signal size. For best approximation, we need to 
minimize the error signal-that is, minimize its size, which is its energy E e over the 
interval [ti, i 2 ] given by 


— / e 2 (t)dt 

Jt l 

= / [/(*) - cx (0] 2 

j ti 


Note that the right-hand side is a definite integral with t as the dummy variable. 
Hence, E e is a function of the parameter c (not t) and E e is minimum for some 
choice of c. To minimize £ e , a necessary condition is 


or , 2 , 

Expanding the squared term inside the integral, we obtain 

— [ 2 f 2 {t) dtl - 4- 2c [ f(t)x(t)dt c 2 [ x 2 {t)dt =0 

dc J tl dc J tl ac J tl J 
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From which we obtain 


ft 2 rt2 

-2 / f(t)x(t)dt + 2c / x 2 (t)dt = 0 

Jt j 

f f(t)x(t)dt tj 

C = tj = pT / /(<)*W dt 

j x 2 (t)dt x 

Jt, 


We observe a remarkable similarity between the behavior of vectors and signals, as 
indicated by Eqs. (3.6) and (3.11). It is evident from these two parallel expressions 
that the area under the product of two signals corresponds to the inner (scalar or 
dot) product of two vectors. In fact, the area under the product of /(f) and x(t ) is 
called the inner product of /(f) and x(t), and is denoted by (/, x). The energy of 
a signal is the inner product of a signal with itself, and corresponds to the vector 
length square (which is the inner product of the vector with itself). 

To summarize our discussion, if a signal /(f) is approximated by another signal 
x(t) as 


then the optimum value of c that minimizes the energy of the error signal in this 
approximation is given by Eq. (3.11). 

Taking our clue from vectors, we say that a signal /(f) contains a component 
cx(t), where c is given by Eq. (3.11). Note that in vector terminology, cx(t ) is 
the projection of /(f) on x(t). Continuing with the analogy, we say that if the 
component of a signal /(f) of the form x(t) is zero (that is, c = 0), the signals 
/(f) and x(t) are orthogonal over the interval [fi, * 2 ]- Therefore, we define the real 
signals /(f) and x(t) to be orthogonal over the interval [fi, * 2 ] iff 


f f(t)x(t) < 
Ju 


I Example 3.1 

For the square signal /(f) shown in Fig. 3.3 find the component in /(f) of the form 
sin f. In other words, approximate /(f) in terms of sin t 

f(t) ~ csin t 0 < t < 2x 

so that the energy of the error signal is minimum. 

In this case 

tt 

x(t) = sin t and E x = I sin 2 (f) dt = 7r 

Jo 


From Eq. (3.11), we find 


1 r 2 * if r f 2 * 4 

— / fit) sin tdt — — / sin tdt+ -sintdf = — 

* Jo * [Jo J * 1 * 


(For complex signals the definition is modified as in Eq. (3.20). 
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Fig. 3.3 Approximation of square signal in terms of a single sinusoid. 


Thus 

4 

/(f) sin f (3.14) 

7T 

represents the best approximation of /(f) by the function sin f, which will minimize the 
error energy. This sinusoidal component of /(f) is shown shaded in Fig. 3.3. By analogy 
with vectors, we say that the square function /(f) depicted in Fig. 3.3 has a component of 
signal sin f and that the magnitude of this component is 4/x. I 

A Exercise E3.1 

Show that over an interval (— x < t < x), the ‘best’ approximation of the signal /(f) = t in 
terms of the function sin f is 2 sin t. Verify that the error signal e(t) = t - 2 sin t is orthogonal 
to the signal sin t over the interval -x < t < x. Sketch the signals f and 2 sin t over the interval 
-x < t < x. v 

3.1-3 Orthogonality in Complex Signals 

So far we have restricted ourselves to real functions of f. To generalize the 
results to complex functions of f, consider again the problem of approximating a 
function /(f) by a function x(t) over an interval (t\ < t < f 2 ): 

/(f) ~ cx(f) (3.15) 

where /(f) and x(t) now can be complex functions of f. Recall that the energy E x 
of the complex signal x(t ) over an interval [fj, f 2 ] is 



In this case, both the coefficient c and the error 

e(f) = /(f) - cx(t) (3.16) 

are complex (in general). For the ‘best’ approximation, we choose c so that E e , the 
energy of the error signal e(t) is minimum. Now, 

[ \f{t)-cx(t)\ 2 dt (3.17) 

Jt 1 

Recall also that 

|u + u| 2 = (u + v)(u* + v*) = \u\ 2 + M 2 + u*v + uv* (3.18) 

Using this result, we can, after some manipulation, rearrange Eq. (3.17) as 
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\f(t)\ 2 dt 


_ j _ r 

Ja 


f(t)x*(t) dt\ + c 




Since the first two terms on the right-hand side are independent of c, it is clear that 
E e is minimized by choosing c so that the third term on the right-hand side is zero. 
This yields 

c=-J- r f(t)x-(t)dt (3.19) 

E x Jh 

In light of the above result, we need to redefine orthogonality for the complex case 
as follows: Two complex functions xi(t) and x 2 (t) are orthogonal over an interval 
(ti < t < t 2 ) if 


/ xi(t)x2 

Jti 


(t) dt = 0 or 


l(t)x 2 (t) dt = 0 


Either equality suffices. This is a general definition of orthogonality, which reduces 
to Eq. (3.12) when the functions are real. 

A Exercise E3.2 

Show that over an interval (0 < t < 2ir), the ‘best’ approximation of the square signal /(f) in 
Fig. 3.3 in terms of the signal e jt is given by ^ e’ { . Verify that the error signal e(t) = /( t)- 
is orthogonal to the signal . V 

Energy of the Sum of Orthogonal Signals 

We know that the square of the length of a sum of two orthogonal vectors is 
equal to the sum of the squares of the lengths of the two vectors. Thus, if vectors 
x and y are orthogonal, and if z = x + y, then 

M 2 = W 2 + |y | 2 

We have a similar result for signals. The energy of the sum of two orthogonal signals 
is equal to the sum of the energies of the two signals. Thus, if signals x(t) and y(t) 
are orthogonal over an interval [ti, * 2 ] , and if z(t) = x(t) + y(t), then 

E Z = E X + E y (3.21) 

We now prove this result for complex signals of which real signals are a special case. 
From Eq. (3.18) it follows that 

f \x(t) + y{t)\ 2 dt = [ \x{t)\ 2 dt + f \y(t)\ 2 dt + [ x{t)y* (t)dt + { x*{t)y(t)dt 

Jt\ Jtl Jt\ 

= J** \x(t)\ 2 dt + \y(t)\ 2 dt (3.22) 


The last result follows from the fact that because of orthogonality, the two integrals 
of the products x(t)y*(t) and x*{t)y(t) are zero [see Eq. (3.20)]. This result can be 
extended to the sum of any number of mutually orthogonal signals. 
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3.2 Signal Comparison: Correlation 

Section 3.1 has prepared the foundation for signal comparison. Here again, we 
can benefit by considering the concept of vector comparison. Two vectors f and x 
are similar if f has a large component along x. In other words, if c in Eq. (3.6) is 
large, the vectors f and x are similar. We could consider c as a quantitative measure 
of similarity between f and x. Such a measure, however, would be defective. The 
degree of similarity between f and x should be independent of the lengths of f and 
x. If we double the length of f, for example, the degree of similarity between f and 
x should not change. From Eq. (3.6), however, we see that doubling f doubles the 
value of c (whereas doubling x halves the value of c). Our measure is clearly faulty. 
Similarity between two vectors is indicated by the angle 9 between the vectors. The 
smaller the 9 , the greater the similarity, and vice versa. The degree of similarity can 
therefore be conveniently measured by cos 6. The larger the cos 9, the greater is the 
similarity between the two vectors. Thus, a suitable measure would be c n — cos 9, 
which is given by 

C " = C0S ' = i^ (3 - 23) 

We can readily verify that this measure is independent of the lengths of f and x. 
This similarity measure c n is known as the correlation coefficient. Observe that 

-1 < c n < 1 (3.24) 

Thus, the magnitude of c n is never greater than unity. If the two vectors are aligned, 
the similarity is maximum (c n = 1). Two vectors aligned in opposite directions 
have the maximum dissimilarity (c n = -1). If the two vectors are orthogonal, the 
similarity is zero. 

We use the same argument in defining a similarity index (the correlation coef- 
ficient) for signals. We shall consider the signals over the entire time interval from 
-00 to 00 . To make c in Eq. (3.11) independent of energies (sizes) of f(t) and x(t), 
we must normalize c by normalizing the two signals to have unit energies. Thus, 
the appropriate similarity index c n analogous to Eq. (3.23) is given by 


1 r 
° n ~ jEjEx L 


f(t)x(t) dt 


Observe that multiplying either f(t) or x(t) by any constant has no effect on this 
index. It is independent of the size (energies) of f(t) and x(t). Using the Schwarz 
inequality,) we can show that the magnitude of c n is never greater than 1 


-1 < c„ < 1 


fSchwarz inequality states that for two real energy signals f(t) and x(t) 

(/ f(t)x(t) dt'j < EfE x (3.25n) 

with equality if and only if x(t) = Kf(t), where K is an arbitrary constant. There is also similar 
inequality for complex signals. 
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The Best Friends, Worst Enemies, and Complete Strangers 


We can readily verify that if f(t) = Kx(t), then c n — 1 when K is any positive 
constant, and c n — -1 when K is any negative constant. Also c n = 0 if /(t) and 
x(t) are orthogonal. Thus, the maximum similarity [when f(t) = Kx(t)] is indicated 
by c n = 1 , the maximum dissimilarity [when f(t) = -Kx(t)] is indicated by c„ = 
— 1. When the two signals are orthogonal, the similarity is zero. Qualitatively 
speaking, we may view orthogonal signals as unrelated signals. Note that maximum 
dissimilarity is different from unrelatedness qualitatively. For example, we have the 
best friends (c„ = 1 ), the worst enemies (c n = - 1 ), and complete strangers, who 
do not care whether we exist or not (c n = 0). The enemies are not strangers, but 
in many ways, people who think like us, only in opposite ways. 

We can readily extend this discussion to complex signal comparison. We gen- 
eralize the definition of c n to include complex signals as 




dt 


( 3 . 27 ) 


1 

*(/) 
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L 

0~ 
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(a) 




Fig. 3.4 Signals for Example 3.2. 


■ Example 3.2 

Find the correlation coefficient c„ between the pulse x(t) and the pulses /i(<), i — 
1, 2, 3, 4, 5, and 6 illustrated in Fig. 3.4. 

We shall compute c„ using Eq. (3.25) for each of the 6 cases. Let us first compute 
the energies of all the signals. 


E x 


f x 2 (t)dt = f dt = 5 
Jo Jo 


(3.28) 


In the same way we find E/, = 5, E / 2 = 1.25, and E / 3 = 5. Also, to determine E/„ and 
E / E , we determine the energy E of e~ at u(t ) over the interval t = 0 to T: 


E = £ (e -**) 2 di = j e~ 2at dt = ^(1 - e~ 2aT ) 

For a = 1/5 and T = 5. Therefore E ft = 2.1617. For / 6 (t), a = 1 and T = oo. 

Therefore E / 5 = 0.5. The energy of Ef 6 is given by 


Efe 


f 


sin 2tt tdt = 2.5 


Using Eq. (3.25), the correlation coefficients for the six cases axe found as 

i r5 

(i) 


(3) 

(5) 


= / 

5 >< 5 > Jo 

i_ r 

/( 5 >( 5 ) J 0 


dt = 1 


( 2 ) 

(-l)dt = -1 (4) 

i=— [ dt = 0.628 ( 6 ) 

Jo 


=L= [ (0.5) dt = 1 
125 )( 5 ) Jo 


^7(2. 1617)<5) 


617X5) l 


e -t/5 dt = 0.961 


sin 2 xt dt = 0 


Comments on the results: Because fi(t) = x(t), the two signals have the maximum 
possible similarity and c n = 1. However, the signal / 2 (f) also shows maximum 
possible similarity with c n = 1. The reason is that we have defined c n to measure 
the similarity of the waveshapes; it is independent of the amplitude (strength) of the 
signals compared. The signal / 2 (f) is identical to x(t) in shape; only the amplitude 
(strength) is different. Hence c n = 1. The signal / 3 (f), on the other hand, has 
the maximum possible dissimilarity with x(t) because it is equal to -x(t). For 
c n = 0.961, implying a high degree of similarity with x(t). This is reasonable 
because / 4 (f) is very similar to x(t) over the duration of x(t) (for 0 < t < 5). Just 
by inspection, we notice that the variations or changes in both x(t ) and / 4 (f) are 
at similar rates. Such is not the case with where we notice that variations in 
/ 5 (f) are generally at a higher rate than those in x(t). There is still considerable 
similarity; both signals always remain positive, and show no oscillations. Both 
signals have zero or negligible strength beyond t = 5. Thus, f$(t) is similar to 
x(t), but not as similar as / 4 (f). This is why c n = 0.628 for fe(t). The signal 
fe(t) is orthogonal to x(t), so that c n = 0. This fact appears to indicate that the 
dissimilarity in this case is not as strong as that of / 3 (f) for which c n = —1. This 
conclusion may seem odd because / 3 (t) appears more similar to x(t) than does 
/s(t). The dissimilarity between x(t) and / 3 (f) is of the nature of antipathy (the 
worst enemy); in a way they are very similar, but in opposite ways. On the other 
hand, the dissimilarity of x(t ) with fe(t) stems from the fact that they are almost 
of different species or from different planets; it is of the nature of being strangers 
to each other. Hence its dissimilarity with x(t) rates lower than that with /3(f). 

A Exercise E3.3 

Show that c n of signals / 2 (f) and / 3 (f) in Fig. 3.4 is —1, that of / 2 (f) and / 4 ft) is 0.961, and 
that of fo{t) and /e(f) is zero. V 


3.2-1 Application to Signal Detection 

Correlation between two signals is an extremely important concept which mea- 
sures the degree of similarity (agreement or alignment) between the two signals. 
This concept is widely used for signal processing applications in radar, sonar, digi- 
tal communication, electronic warfare and many others. 

We explain this concept by an example of radar where a signal pulse is trans- 
mitted in order to detect a suspected target. If a target is present, the pulse will be 
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reflected by it. If a target is not present, there will be no reflected pulse, just noise. 
The presence or absence of the reflected pulse confirms the presence or absence of 
a target. The crucial problem in this procedure is to detect the heavily attenuated, 
reflected pulse (of known waveform) buried in the unwanted noise signal. In this sit- 
uation, correlation of the received pulse with the transmitted pulse can be of great 
help. A similar situation exists in digital communication where we are required to 
detect the presence of one of the two known waveforms in the presence of noise. 

We now explain qualitatively how signal detection using correlation technique 
is accomplished. Consider the case of binary communication, where two known 
waveforms are received in a random sequence. Each time we receive a pulse, our 
task is to determine which of the two (known) waveforms is received. To make the 
detection easier, we must make the two pulses as dissimilar as possible. Therefore, 
we should select the pulse that is the negative of the other pulse. This choice gives 
the highest dissimilarity (c„ = -1). This scheme is sometimes called the antipodal 
scheme. We can also use orthogonal pulses which result in c n = 0. In practice, both 
these options are used, although antipodal is the best in terms of distinguishahility 
between the two pulses. 

Now let us consider the antipodal scheme in which the two pulses are p{t) and 
— p(t). The correlation coefficient c n of these pulses is — 1. Assume that there is 
no noise or any other imperfections in the transmission. The receiver consists of a 
correlator which computes the correlation between p(t) and the received pulse. If the 
correlation is 1, we decide that p(t) is received, and if the correlation is —1, we decide 
that —p(t) is received. Because of the maximum possible dissimilarity between the 
two pulses, detection is easier. The situation is almost like that in a fairy tale, where 
everybody lives happily ever after. In practice, however, several imperfections occur. 
There is always an unwanted signal (noise) superimposed on the received pulses. 
Moreover, during transmission, pulses get distorted and dispersed (spread out) in 
time. Consequently, a received pulse is corrupted by overlapping tails from other 
pulses. This changes the shape of received pulses, and the correlation coefficient is 
no more ±1, but has a smaller magnitude, thus reducing the distinguishahility of 
pulses. We use a threshold detector, which decides that if the correlation is positive 
(c n > 0), the received pulse is p(f), and if the correlation is negative (c„ < 0), the 
received pulse is -p(t). 

Suppose, for example, that p(t) has been transmitted. In the ideal case, corre- 
lation of this pulse at the receiver would be 1, the maximum possible. Now because 
of the noise and other imperfections, the correlation is going to be less than 1. In 
some extreme situation, the noise and overlapping from other pulses can make this 
pulse so dissimilar to p(t) that the correlation can be a negative amount. In this 
case, the threshold detector decides that — p(t) has been received, thus causing a 
detection error. In the same way, if — p(t) is transmitted, the channel noise, pulse 
distortion, and the overlapping from other pulses could result in a positive corre- 
lation, causing a detection error. Our task is to make sure that the transmitted 
pulses have sufficient energy to keep the relative damage to the pulse caused by 
noise within a limit and the error probability below acceptable bounds. In the ideal 
case, the margin provided by the correlation c n for distinguishing the two pulses 
is 2 (from 1 to -1 and vice versa). The noise and other imperfections reduce this 
margin. That is why it is important to start with as large a margin as possible. 
For this reason the antipodal scheme has the best performance in terms of guarding 
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Fig. 3.5 Physical explanation of the correlation function. 

against the channel noise and other imperfections. However, as mentioned earlier, 
because of some other reasons, different schemes such as an orthogonal scheme, 
where c n = 0, are also used even when they provide a smaller margin (from 0 to 1 
and vice versa) in distinguishing the pulses. 

Some aspects of pulse dispersion were discussed in Secs. 2.7-5 and 2.7-6. In 
chapter 4, we shall discuss pulse distortion during transmission. Calculation of error 
probability in the presence of noise and other imperfections are beyond the scope 
of this work. For a detailed treatment of this subject, the reader may refer to the 
author’s book on communication systems. 1 

3.2-2 Correlation Functions 

Consider an application of correlation to signal detection in a radar, where 
a signal pulse is transmitted in order to detect a suspected target. If a target is 
present, the pulse will be reflected by it. In contrast, if the target is not present, 
there will be no reflected pulse, just noise. By detecting the presence or absence of 
the reflected pulse we confirm the presence or absence of the target. By measuring 
the time delay between the transmitted and received (reflected) pulse we determine 
the distance of the target. Let the transmitted and the reflected pulses be denoted 
by g{t) and /(t), respectively, as shown in Fig. 3.5. If we were to use Eq. (3.25) 
directly to measure the correlation coefficient c n , we would obtain 

1 f°° 

c n = -=L=/ f(t)g(t)dt = 0 (3.29) 

y £ f^g J — oo 

Thus, the correlation is zero because the pulses are disjoint (nonoverlapping in 
time). The integral (3.29) will yield zero value even when the pulses are identical 
but with relative time shift. To avoid this difficulty, we compare the received pulse 
f(t) with a delayed pulse g(t) for various values of delay. If for some value of delay 
parameter there is a strong correlation, we not only detect the presence of the pulse 
but we also detect the relative time shift of f(t) with respect to g{t). For this 
reason, instead of using the integral on the right-hand, we use the modified integral 
the crosscorrelation function of two real signals f(t) and g(t) defined byf 


fFor complex signals we define 


/ oo 

f*( T )g( T ~ t) dr 
•oo 
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lf/s(f)5 / f(r)g(r - t)dr (3.30) 

Here r is a dummy variable, and the pulse g(r — t) is the pulse g(r) delayed by 
t seconds with respect to the /(r) pulse. Therefore, 4>f g (t) is an indication of 
similarity (correlation) of the / pulse with g pulse delayed by t seconds. Thus, 
i>f g {t ) measures the similarity of pulses even if they are disjoint. In the case of 
signals in Fig. 3.5, ipf g (t) will show significant correlation around t — T. This 
observation allows us not only to detect the presence of the target, but also to 
calculate its distance. 

Convolution and Correlation 

We now examine the close connection between the convolution and the correla- 
tion of f(t) and g(t) [given by Eq. (3.30)]. Note that p(r-t) is the g(r) time-shifted 
by t. Thus, ipf g [t) is equal to the area under the product of the / pulse and g pulse 
time-shifted by t (without time-inversion). In convolution also we follow the same 
procedure, except that the g pulse is time-inverted before it is shifted by i. This 
observation suggests that r/j/ s (t) is equal to f(t) * g(-t ) [the convolution of f(t) 
with time-inverted j(t)], that is, 

*/,(*) = /W*tf(-0 (3.31) 

This can be formally proved as follows. Letting g(-t) = w(t), 

f(t)*g(-t) = /(t) *w(t) = f f(r)w(t - T)dr = f /(r)p(r - t) dr = i) fg (t) 
J - oo J — oo 

To reiterate, is equal to the area under the product of the / pulse and g 

pulse time-shifted by t (without time- inversion), and is given by the convolution of 
f(t) with g(-t). 

A Exercise E3.4 

Show that tpfg{t), the correlation function of f(t ) and g(t ) in Fig. 2.11 is given by c(t) in 
Fig. 2.12. V 
A Exercise E3.5 

Show that xl)f g {t), the correlation function of f(t) and g(t) in Fig. 2.12 is given by c(£) in 
Fig. 2.11. V 

Autocorrelation Function 

Correlation of a signal with itself is called the autocorrelation. The autocor- 
relation function tf(t) of a signal f(t) is defined as 

/ OO 

-t)dr (3.32) 

-OO 

In Chapter 4, we shall show that the autocorrelation function provides valuable 
spectral information about the signal. 
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Fig. 3.6 Representation of a vector in three-dimensional space. 


3.3 Signal representation by Orthogonal Signal Set 

In this section we show a way of representing a signal as a sum of orthogonal 
signals. Here again we can benefit from the insight gained from a similar problem in 
vectors. We know that a vector can be represented as a sum of orthogonal vectors, 
which form the coordinate system of a vector space. The problem in signals is 
analogous, and the results for signals are parallel to those for vectors. So, let us 
review the ease of vector representation. 

3.3-1 Orthogonal Vector Space 

Let us investigate a three-dimensional Cartesian vector space described by three 
mutually orthogonal vectors xj, X 2 , and X 3 , as illustrated in Fig. 3.6. First, we 
shall seek to approximate a three-dimensional vector f in terms of two mutually 
orthogonal vectors xj and X 2 : 

f ~ C1X1 -I- C2X2 

The error e in this approximation is 

e = f - (ciXi + C2X2) 
or 

f = cixj + C 2 X 2 + e 

As in the earlier geometrical argument, we see from Fig 3.6 that the length of e is 
minimum when e is perpendicular to the X 1 -X 2 plane, and c iXj and C 2 X 2 are the 
projections (components) of f on xj and X2, respectively. Therefore, the constants 
ci and C 2 are given by formula (3.6). Observe that the error vector is orthogonal to 
both the vectors xi and X 2 . 

Now, let us determine the ‘best’ approximation to f in terms of all three mu- 
tually orthogonal vectors xi,X 2 , and X 3 : 


f ~ C1X1 + C2X2 + C3X3 


(3.33) 
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Figure 3.6 shows that a unique choice of ci, c 2 , and C 3 exists, for which (3.33) is no 
longer an approximation but an equality 


f = cxxi + c 2 x 2 + C3X3 ( 3 . 34 ) 

In this case, ciXj,c 2 x 2 , and C3X3 are the projections (components) of f on Xi,x 2 , 
and X3, respectively; that is, 

Ci = ( 3 . 35 a) 

Xi ■ Xi 



Note that the error in the approximation is zero when f is approximated in terms 
of three mutually orthogonal vectors: xi,x 2 , and X3. The reason is that f is a 
three-dimensional vector, and the vectors xi,x 2 , and X3 represent a complete set 
of orthogonal vectors in three-dimensional space. Completeness here means that 
it is impossible to find another vector X 4 in this space, which is orthogonal to all 
the three vectors xi,x 2 , and X3. Any vector in this space can then be represented 
(with zero error) in terms of these three vectors. Such vectors are known as basis 
vectors. If a set of vectors {x<} is not complete, the error in the approximation 
will generally not be zero. Thus, in the three-dimensional case discussed above, it 
is generally not possible to represent a vector f in terms of only two basis vectors 
without an error. 

The choice of basis vectors is not unique. In fact, a set of basis vectors corre- 
sponds to a particular choice of coordinate system. Thus, a 3-dimensional vector 
f may be represented in many different ways, depending on the coordinate system 
used. 


3.3-2 Orthogonal Signal Space 

We start with real signals first, and then extend the discussion to complex 
signals. We proceed with our signal approximation problem using clues and insights 
developed for vector approximation. As before, we define orthogonality of a real 
signal set xi(t), x 2 (t), • • • ,xjv(t) over interval [fi, f 2 ] as 


J da ( 0 m 7 ^ n 

x m (t)x n (t) dt = < (3.36) 

ti [E n m — n 

If the energies E n — 1 for all n, then the set is normalized and is called an or- 
thonormal set . An orthogonal set can always be normalized by dividing x n (t ) by 
VeO for all n. 

Now, consider approximating a signal f(t) over the interval [fj, < 2 ] by a set of 
N real, mutually orthogonal signals xi(f), x 2 (t), . . ., ijv(t) as 


f(t) re Cixi(t) + c 2 x 2 (f) H 1- cjvxjv(f) (3.37a) 

N 

= £c n x n (f) (3.37b) 

n=l 

The error e(t) in the approximation (3.37) 
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e(t) = /(*) - £ c n x n(t) 


(3.38) . 


We show in Appendix 3A that E e , the energy of the error signal e(t), is minimized 
if we choose 


d 2 

/ f(t)x n (t)dt 

_ Jt, 

rtz 

/ x n 2 (t)dt 

Jt 1 

1 2 

= — f(t)x n (t)dt 

E n Jn 


n = 1 , 2 ,..., A 


(3.39b) 


For this choice of the coefficients c n , it is shown in Appendix 3 A that the error 
signal energy E e is given by 


r t 2 N 

E e = f 2 (t)dt~Y,Cn 2 E n 

■ffl n=l 


Observe that the error energy E e generally decreases as N, the number of terms, 
is increased because the term Ck 2 Ek is nonnegative. Hence, it is possible that the 
error energy — * 0 as N — > 00 . When this happens, the orthogonal signal set is said 
to be complete. In this case, Eq. (3.37b) is no more an approximation but an 
equality 

f(t) = cin(t) + c 2 x 2 (t) + h c n x n (t) H 


= £c n X n (f) tl <t <t 2 


where the coefficients c n are given by Eq. (3.39). Because the error signal energy 
approaches zero, it follows that the energy of f(t ) is now equal to the sum of the 
energies of its orthogonal components cixi(t), c 2 x 2 (t), C 3 X 3 (t), 

The series on the right-hand side of Eq. (3.41) is called the generalized 
Fourier series of f(t) with respect to the set (x n (f)}. When the set (x n (t)} 
is such that the error energy E e — * 0 as N — * 00 for every member of some partic- 
ular class, we say that the set {x n (t)} is complete on [ti, t 2 ] for that class of /(f), 
and the set {x„(t)} is called a set of basis functions or basis signals. Unless 
otherwise mentioned, in future we shall consider only the class of energy signals. 

Thus, when the set (x n (t)} is complete, we have the equality (3.41). One 
subtle point that must be understood clearly is the meaning of equality in Eq. 
(3.41). The equality here is not an equality in the ordinary sense, but in the sense 
that the error energy, that is, the energy of the difference between the two sides of 
Eq. (3.41), approaches zero. If the equality exists in the ordinary sense, the error 
energy is always zero, but the converse is not necessarily true. The error energy can 
approach zero even though e(t), the difference between the two sides, is nonzero at 
some isolated instants. The reason is that even if e(t) is nonzero at such instants, 
the area under e 2 (t) is still zero; thus the Fourier series on the right-hand side of 
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Eq. (3.41) may differ from /(t) at a finite number of points. In fact, when /(f) has 
a jump discontinuity at t = to, the corresponding Fourier series at f 0 converges to 
the mean of /(to + ) and /(to - )- 

In Eq. (3.41), the energy of the left-hand side is £/, and the energy of the 
right-hand side is the sum of the energies of all the orthogonal components.) Thus 



dt = Ci 2 Ui C2 2 £-2 + • • ■ 


= ]Tc n 2 £ n 

n=l 


(3.42) 


This equation goes under the name of Parseval’s theorem. Recall that the signal 
energy (area under the squared value of a signal) is analogous to the square of the 
length of a vector in the vector-signal analogy. In vector space we know that the 
square of the length of a vector is equal to the sum of the squares of the lengths of 
its orthogonal components. The above equation (3.42) is the statement of this fact 
as it applies to signals. 


Generalization to Complex Signals 

The above results can be generalized to complex signals as follows: A set of 
functions xi(f), X 2 (t), . . ., xjv(t) is mutually orthogonal over the interval [f lt < 2 ] if 


J da (0 m # n 

x m (t)x*(t) dt = < (3.43) 

ti [E n m — n 

If this set is complete for a certain class of functions, then a function f(t) in this 
class can be expressed as 

f(t) = cixi(t) + C 2 X 2 M H b CiXi(t) -I (3-44) 


where 

c„= -±- F f(t)x* n (t)dt (3.45) 

Jti 

Equation (3.39) [or Eq. (3.45)] shows one interesting property of the coefficients 
of ci, C 2 , • • ., cm; the optimum value of any coefficient in the approximation (3.37) is 
independent of the number of terms used in the approximation. For example, if we 
have used only one term ( N = 1) or two terms ( N — 2) or any number of terms, the 
optimum value of the coefficient c, would be the same [as given by Eq. (3.39)]. The 
advantage of this approximation of a signal f(t) by a set of mutually orthogonal sig- 
nals is that we can continue to add terms to the approximation without disturbing 
the previous terms. This property of finality of the values of the coefficients is very 


(Note that the energy of a signal cx(t) is c 2 Ex- 
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important from a practical point of view.) 

Some Examples of Generalized Fourier Series 

Signals are vectors in every sense. Like a vector, a signal can be represents as 
a sum of its components in a variety of ways. Just as vector coordinate systems are 
formed by mutually orthogonal vectors (rectangular, cylindrical, spherical), we also 
have signal coordinate systems (basis signals) formed by a variety of sets of mutually 
orthogonal signals. There exist a large number of orthogonal signal sets which can 
be used as basis signals for generalized Fourier series. Some well-known signal 
sets are trigonometric (sinusoid) functions, exponential functions, Walsh functions, 
Bessel functions, Legendre polynomials, Laguerre functions, Jacobi polynomials, 
Hermite polynomials, and Chebyshev polynomials. The functions that concern us 
most in this book are the trigonometric and the exponential sets discussed in the 
rest of the chapter. 

A Historical Note: Baron Jean-Baptiste-Joseph Fourier (1768-1830) 

The Fourier series and integral is a most beautiful and fruitful development, 
which serves as an indispensable instrument in the treatment of many problems in 
mathematics, science, and engineering. Maxwell was so taken by the beauty of the 
Fourier series that he called it a great mathematical poem. In electrical engineering, 
it is central to the areas of communication, signal processing and several other fields, 
including antennas, but it was not received enthusiastically by the scientific world 
when it was presented. In fact, Fourier could not get his results published as a 
paper. 

Fourier, a tailor’s son, was orphaned at age 8 and educated at a local military 
college (run by Benedictine monks), where he excelled in mathematics. The Bene- 
dictines prevailed upon the young genius to choose the priesthood as his vocation, 
but the revolution broke out before he could take his vows. Fourier joined the peo- 
ple’s party. But in its early days, the French Revolution, like most revolutions of 
its kind, liquidated a large segment of the intelligentsia, including prominent scien- 
tists such as Lavosier. This persecution caused many intellectuals to leave France 
to save themselves from a rapidly rising tide of barbarism. Fourier, who was an 
early enthusiast of the Revolution, narrowly escaped the guillotine twice. It was 
to the everlasting credit of Napoleon that he stopped the persecution of the intelli- 
gentsia and founded new schools to replenish their ranks. The 26-year old Fourier 
was appointed chair of mathematics at the newly created school Ecole Normale in 
1794. 2 


(Contrast this situation with the polynomial approximation of f(t). Suppose we wish to approxi- 
mate /(£) by a polynomial in t such that the polynomial is equal to /(£) at two points t\ and £2- 
This can be done by choosing a first order polynomial ao + ai£ with 

f(ti) = ao + aiii and f{t2) = ao + ai£2 

Solution of these equations yields the desired values of ao and a\ . For a three- point approximation, 
we must choose the polynomial ao + ai£ + 02 £ 2 with 

f(U) = ao + aiti + a,2ti 2 i = 1 , 2 , and 3 

The approximation improves with larger number of points (higher-order polynomial), but the 
coefficients ao, ai, 02, • • • do not have the finality property. As we increase the number of terms 
in the polynomial, we need to recalculate the coefficients. 
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Joseph Fourier (left) and Napoleon (right). 


Napoleon was the first modern ruler with a scientific education, and he was one 
of the rare persons who was equally comfortable with soldiers and scientist. The age 
of Napoleon was one of the most fruitful in the history of science. Napoleon liked 
to sign himself as a ‘member of institut de jRrance’(a fraternity of scientists), and he 
once expressed to Laplace his regret that “force of circumstances has led me so far 
from the career of a scientist.” 3 Many great figures in science and mathematics, in- 
cluding Fourier and Laplace, were honored and promoted by Napoleon. In 1798, he 
took a group of scientists, artists, and scholars — Fourier among them — on his Egyp- 
tian expedition, with the promise of an exciting and historic union of adventure and 
research. Fourier proved to be a capable administrator of the newly formed Insti- 
tut d’Egypte, which, incidentally, was responsible for the discovery of the Rosetta 
Stone. The inscription on this stone in two languages and three scripts (hiero- 
glyphic, demotic, and Greek) enabled Thomas Young and Jean-Francois Champol- 
lion, a protege of Fourier, to invent a method of translating hieroglyphic writings 
of ancient Egypt-the only significant result of Napoleon’s Egyptian expedition. 

Back in France in 1801, Fourier briefly served in his former position as pro- 
fessor of mathematics at the Ecole Polytechnique in Paris. In 1802 Napoleon ap- 
pointed him the prefect of Isere (with its headquarters in Grenoble), a position in 
which Fourier served with distinction. Fourier was created Baron of the Empire by 
Napoleon in 1809. Later, when Napoleon was exiled to Elba, his route was to take 
him through Grenoble. Fourier had the route changed to avoid meeting Napoleon, 
which would have displeased Fourier’s new master, the Bourhon King Louis XVIII. 
Within a year, Napoleon escaped from Elba. On his way home, at Grenoble, Fourier 
was brought before him in chains. Napoleon scolded Fourier for his ungrateful be- 
havior but reappointed him the prefect of Rhone at Lyons. Within four months 
Napoleon was defeated at Waterloo, and was exiled to St. Helena, never to return. 
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Fourier once again was in disgrace as a Bonapartist, and had to pawn his effects to 
keep himself alive. But through the intercession of a former student, who was now 
a prefect of Paris, he was appointed director of the statistical bureau of the Seine, 
a position that allowed him ample time for scholarly pursuits. Later, in 1827, he 
was elected to the powerful position of perpetual secretary of the Paris Academy of 
Science, a section of the institute. 4 

While serving as the prefect of Grenoble, Fourier carried on his elaborate in- 
vestigation of propagation of heat in solid bodies, which led him to the Fourier 
series and the Fourier integral. On 21 December 1807, he announced these results 
in a prize paper on the theory of heat. Fourier claimed that an arbitrary func- 
tion (continuous or with discontinuities) defined in a finite interval by an arbitrarily 
capricious graph can always be expressed as a sum of sinusoids (Fourier series). The 
judges, who included the great French mathematicians Laplace, Lagrange, Monge, 
and LaCroix admitted the novelty and importance of Fourier’s work, but criticized 
it for lack of mathematical rigor and generality. Lagrange thought it incredible that, 
a sum of sines and cosines could add up to anything but an infinitely differentiable 
function. Moreover, one of the properties of an infinitely differentiable function is 
that if we know its behavior over an arbitrarily small interval, we can determine its 
behavior over the entire range (the Taylor-Maclaurin series). Such a function is far 
from an arbitrary or a capriciously drawn graph. 5 Fourier thought the criticism un- 
justified but was unable to prove his claim because the tools required for operations 
with infinite series were not available at the time. However, posterity has proved 
Fourier to be closer to the truth than his critics. This is the classic conflict between 
pure mathematicians and physicists or engineers, as we shall see again in the life 
of Oliver Heaviside (p. 381). In 1829 Dirichlet proved Fourier's claim concerning 
capriciously drawn functions with a few restrictions (Dirichlet conditions). 

Although three of the four judges were in favor of publication, this paper was 
rejected because of vehement opposition by Lagrange. Fifteen years later, after 
several attempts and disappointments, Fourier published the results in expanded 
form as a text, Theorie analytique de la chaleur, which is now a classic. 


3.4 Trigonometric Fourier Series 

Consider a signal set: 

{1, cos wot, cos 2wot, . . . , cos nwo t, . . . ; 

sin wot, sin 2wot, .... sin nwof, ■ . .} (3.46) 

A sinusoid of frequency nw o is called the nth harmonic of the sinusoid of frequency 
wo when n is an integer. In this set the sinusoid of frequency wo, called the funda- 
mental, serves as an anchor of which all the remaining terms are harmonics. Note 
that the constant term 1 is the 0th harmonic in this set because cos(0 x wot) = 1. 
In Appendix 3B we show that this set is orthogonal over any interval of duration 
To = 2x/wo, which is the period of the fundamental. Specifically, we have shown 
that 

r ( 0 n ^ m 

/ cos nwot cos mwotdt = < (3.47a) 

JT 0 [ m = n 0 
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/ sin moot sin moot dtt = 
Jto 


» = ra/0 


/ sin moot cos moot dt = 0 for all n and m 

Jt 0 


(3.47b) 


(3.47c) 


The notation J To means the integral over an interval from t = t\ to t\ + To for 
any value of ti- These equations show that the set (3.46) is orthogonal over any 
contiguous interval of duration T 0 . This is the trigonometric set, which can 
be shown to be a complete set. 6 ’ 7 Therefore, we can express a signal f(t) by a 
trigonometric Fourier series over any interval of duration To seconds as 


f(t) = ao + a\ cos oo t + a i cos 2u>ot + • 
+ bi sin toot + 62 sin 2oot + ■ 


£1 < t < ti + T 0 (3.48a) 


fit) = ao + E a n cos moot + b n sin moot h <t < t\ +Tq 


(3.48b) 


Using Eq. (3.39), we can determine the Fourier coefficients a 0 , a n , and b n . Thus 


ft 

/ }{t) cos ruoatdt 

Jt, 

rti+To 

/ cos 2 moot dt 

■It, 


The integral in the denominator of Eq. (3.50) as seen from Eq. (3.47a) (with m = n) 
is T 0 /2 when n ± 0. Moreover, for n = 0, the denominator is T 0 . Hence 


1 rti+To 

a ° = To Jt ^ 

2 1+T0 

a n = — / f{t) cos ruootdt n = 1,2,3,... 

To Jt, 


Arguing the same way, we obtain 


2 rt-i+To 

b n = — /(t)sin ruootdt n = 1,2,3,... 

To Jt, 


(3.51a) 


(3.51b) 


(3.51c) 


Compact Trigonometric Fourier Series 

The trigonometric Fourier series in Eq. (3.48) contains sine and cosine terms 
of the same frequency. We can combine the two terms to obtain a single sinusoid 
of the same frequency using the trigonometric identity 


a„ cos moot + 6„ sin moot — C n cos (moot + 6 n ) 


(3.52) 
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Cn = V On 2 + bn 


(3.53b) 


For consistency, we denote the dc term a 0 by Co, that is 

Co = uo (3.53c) 

Using the identity (3.52), the trigonometric Fourier series in Eq. (3.48) can be 
expressed in the compact form of the trigonometric Fourier series as 

OO 

f(t) = Co + Cn cos (moot + 6 n ) h < t < h + T 0 (3.54) 

n=l 

where the coefficients C n and 6 n are computed from a n and b n using Eqs. (3.53). 

Equation 3.51a shows that a 0 (or Co) is the average value of f(t) (averaged 
over one period). This value can often be determined by inspection of f(t). 

■ Example 3.3 

Find the compact trigonometric Fourier series for the exponential e~ t/ 2 depicted in 
Fig. 3.7a over the shaded interval 0 < ( < ir. 

Because we are required to represent f(t) by the trigonometric Fourier series over the 
interval 0 < t < it only, To = 7r, and the fundamental frequency is 


Therefore 


2 ti „ 
= - = 2 


f(t) = ao + E o„ cos 2nt + fe„ sin 2nt 0 < t < it 


where [from Eq. (3.51a)] 


e~ t/2 dt = 0.504 


a n = lj 0 e " !/2cos2ntdi = 0 - 504 (lTTfou) 


U + 16 n 2 J 


b n — — I e sin 2nt dt = 0.504 


Therefore 


/(*) = 0.504 1 + TI 1 | ( CQS 2nt + 4nsin 2 nt) 


To find the compact Fourier series, we compute its coefficients using Eq. (3.53) as 


Co = ao = 0.504 


C n = \Jal + bn = 0.504 a 


(l+16n 2 ) 2 ^ (l+16n 2 P 


:0 - 504 (^) 


= tan '(— 4n) = — tan 1 4n 




(3.55) 
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Fig. 3.7 A periodic signal and its Fourier spectra. 


The values of C n and 8 n for the dc and the first seven harmonics are computed from 
the above equation and displayed in Table 3.1. Using these numerical values, we can 
express /(f) in the compact trigonometric Fourier series as 


/(f) = 0.504 + 0.504^ 


Vl + 16n 2 


cos (2n t - tan 1 4n) 


0 < f < tr 


(3.56a) 


= 0.504 + 0.244 cos (2t - 75.96°) + 0.125 cos (4t - 82.87°) 
+ 0.084 cos (6t - 85.24° ) + 0.063 cos (8t - 86.42° ) + • 


0 < t < 7T (3.56b) 


Remember that the right-hand side represents e '^ 2 over the interval 0 to n only. Outside 
this interval, the two sides need not be equal. 


Table 3.1 


ra 

0 

_ T"1 

2 | 

3 

4 

5 ! 

6 

7 ! 

Ejj 

0.504 

0.244 

0.125 

0.084 

0.063 

0.0504 | 

0.042 

0.036 | 

BB 



-82.87 

-85.24 

-86.42 

ESB3U 

-87.61 

-87.95 | 


Periodicity of the Trigonometric Fourier Series 

We have shown how an arbitrary signal /(f) may be expressed as a trigonomet- 
ric Fourier series over any interval of T 0 seconds. In Example 3.3, for instance, we 
represented e _f/2 over the interval from 0 to tr/2 only. The Fourier series found in 
Eq. (3.56) is equal to e~ t/2 over this interval alone. Outside this interval the series 
is not necessarily equal to e~*/ 3 . It would be interesting to find out what happens 
to the Fourier series outside this interval. We now show that the trigonometric 
Fourier series is a periodic function of period T 0 (the period of the fundamental). 
Let us denote the trigonometric Fourier series on the right-hand side of Eq. (3.54) 
by i p(t). Therefore 


ip(t) = Co + ^2 Cn COS (nuigt + 6 n ) for all t 
and n=1 

oo 

<p(t + To) = Co -t- ^ C n cos [na>o(f + To) + 9 n ] 

n— 1 
oo 

= Co + ^2 Cn cos [(nu>ot + 2n7r) + 0 n ] 

n—1 

oo 

= Co + ^ C n cos (ruoot + 9 n ) 

71=1 

= ip(t) for all t (3.57) 

This result shows that the trigonometric Fourier series is a periodic function of 
period T 0 (the period of its fundamental). For instance, ip(t), the Fourier series on 
the right-hand side of Eq. (3.56), is a periodic function in which the segment of /(f) 
in Fig. 3.7a over the interval (0 < f < n) repeats periodically every 7 r seconds, as 
illustrated in Fig. 3.7b.j Thus, when we represent a signal f(t) by the trigonometric 
Fourier series over a certain interval of duration To, the function f(t) and its Fourier 
series (p(t ) need be equal only over that interval of T 0 seconds. Outside this interval, 
the Fourier series repeats periodically with period T 0 . 

Now, if the function f(t) were itself to be periodic with period T 0 , then a 
Fourier series representing /(<) over an interval T 0 will also represent /(f) for all t 
(not just over the interval T 0 ). Another interesting fact, as seen in Fig. 1.7, is that a 
periodic signal /(f) can be generated by a periodic repetition of any of its segment 
of duration To- Therefore, the trigonometric Fourier series representing a segment 
of /(t) of duration T 0 starting at any instant represents /(f) for all f. Therefore, it 
follows that in computing the coefficients do, a n and 6 n , we may use any value for 
fi in Eqs. (3.51). In other words, we may perform this integration over any interval 
of To. Thus the Fourier coefficients of a series representing a periodic signal /(f) 
(for all f) can be expressed as 


ao = 7F / /W dt (3.58a) 

J o Jt 0 


fin reality, the series convergence at the points of discontinuity shows about 9% overshoot (Gibbs 
phenomenon 6 ) as discussed later. 
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a„ = — / f(t) cos nwot dt n = 1,2,3,... (3.58b) 

To Jt„ 

and 

b n = — f f(t) sin nwot dt n = 1,2, 3, ... (3.58c) 

To Jt 0 

where f T means that the integration is performed over any interval of To seconds. 

The Fourier Spectrum 

The compact trigonometric Fourier series in Eq. (3.54) indicates that a periodic 
signal f(t) can be expressed as a sum of sinusoids of frequencies 0 (dc), wo, 2w 0 , ■ ■ •, 
na>o, • • whose amplitudes are Co, Ci, C2, • • ., C n , • • •, and whose phases are 0, 6 1, 
$ 2 , ■ • 0n, ■ • respectively. We can readily plot amplitude C„ vs. w (amplitude 

spectrum) and 9 n vs. w (phase spectrum). These two plots together are the 
frequency spectra of f(t). 

Figures 3.7c and 3.7d show the amplitude and phase spectra for the periodic 
signal <p(t) in Fig. 3.7b. These spectra tell us at a glance the frequency composition 
of tp(t); that is, the amplitudes and phases of various sinusoidal components of 
tp{t). Knowing the frequency spectra, we can reconstruct or synthesize ¥>(t), as 
shown on the right-hand side of Eq. (3.56). Therefore, the frequency spectra in 
Figs. 3.7c and 3.7d provide an alternative description— the frequency-domain 
description of tp(t). The time-domain description of <p(t) is depicted in Fig. 3.7b. 
A signal, therefore, has a dual identity: the time-domain identity tp(t) and the 
frequency-domain identity (Fourier spectra ). The two identities complement each 
other; taken together, they provide a better understanding of a signal. 

Series Convergence at Jump Discontinuities 

An interesting aspect of a Fourier series is that whenever there is a jump 
discontinuity in f(t), the series at the point of discontinuity converges to an average 
of the left-hand and right-hand limits of f(t) at the instant of discontinuity.) In 
Fig. 3.7b, for instance, yj(t) is discontinuous at t = 0 with v?(0 + ) = 1 and <p(0~) = 
e~ lr f 2 - 0.208. The corresponding Fourier series converges to a value (l+0.208)/2 = 

0.604 at t = 0. This conclusion is easily verified from Eq. 3.56b by setting t = 0. 


Existence of the Fourier Series: Dirichlet Conditions 

There are two basic conditions for the existence of the Fourier series 

1. For the series to exist, the coefficients ao, a n , and b n in Eq. (3.51) must be 
finite. From Eqs. (3.51a), (3.51b), and (3.51c), it follows that the existence of these 
coefficients is guaranteed if /(f) is absolutely integrable over one period; that is, 



(3.59) 


/This behavior of the Fourier series is dictated by its error energy minimization property, discussed 
in Sec. 3.3. 
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This condition is known as the weak Dirichlet condition. If a function /(f) sat- 
isfies the weak Dirichlet condition, the existence of a Fourier series is guaranteed, 
but the series may not converge at every point. For example, if a function /(f) is 
infinite at some point, then obviously the series representing the function will be 
nonconvergent at that point. Similarly, if a function has an infinite number of max- 
ima and minima in one period, then the function contains an appreciable amount 
of components of frequencies approaching infinity. Consequently, the coefficients 
in the series at higher frequencies do not decay rapidly, so that the series will not 
converge rapidly or uniformly. Thus, for a convergent Fourier series, in addition to 
condition (3.59), we require that 

2. The function /(f) have only a finite number of maxima and minima in one 
period, and only a finite number of finite discontinuities in one period. These two 
conditions are known as the strong Dirichlet conditions. We note here that any 
periodic waveform that can be generated in a laboratory satisfies strong Dirichlet 
conditions, and hence possesses a convergent Fourier series. Thus, a physical possi- 
bility of a periodic waveform is a valid and sufficient condition for the existence of 
a convergent series. 

I Example 3.4 

Find the compact trigonometric Fourier series for the periodic square wave /(f) illus- 
trated in Fig. 3.8a, and sketch its amplitude and phase spectra. 

Here, the period To = 2x and wo = 2x/To = 1. Therefore 

OO 

f(t) = ao + a„ cos nt + b n sin nt 

n=l 

where+ 

uq = y o j /(*) dt 

In the above equation we may integrate f(t) over any interval of duration To = 2x. Figure 
3.8a shows that the best choice for a region of integration is from — x to x. Because 
/(<) = 1 only over (-f , f ) and /(t) = 0 over the remaining segment, 

i r 1 2 1 

ao = — y dt = - (3.60a) 

We could have easily deduced that ao, the average value of f(t), is 5 merely by inspection 
of f(t) in Fig. 3.8a. Also, 

1 /* 7T/2 2 /nx\ 

a n = — / cos nt dt = — sm — 
x J_ n/2 nx \ 2 / 

n even 

n =1, 5, 9, 13, ••• (3.60b) 

n =3, 7, 11, 15, 

i r n 

b n =— sinntdt = 0 (3.60c) 

" J-n/2 



I 



Fig. 3.8 A square pulse periodic signal and its Fourier spectra. 


Therefore 




111 

cos t - - cos 3f + - cos 5 t - - cos 7 1 + ■ 
3 5 7 


Observe that b n = 0 and all the sine terms are zero. Only the cosine terms appear in the 
trigonometric series. The series is therefore already in the compact form except that the 
amplitudes of alternating harmonics are negative. Now, by definition, amplitudes C n are 
positive [see Eq. (3.53a)]. The negative sign can be accommodated by a phase of ■n radians 
as seen from the trigonometric identityf 

- cos x = cos (x - it) 

Using this fact, we can express the series in (3.61) as 

f(t) = i + — [cos t + i cos (3t - it) + i cos 5t + \ cos (7 1 - it) + i cos 9t 4 1 

2 7T L o 5 ' y -I 

This is precisely the Fourier series in the compact trigonometric form. The amplitudes are 

C0 = i 



n even 
n odd 


7 0 for all n ^3,7, 11,15,- 

1-rr n = 3,7, 11,15, 


(Because cos (x±ir) = — cos x, we could have chosen the phase ir or — ir. In fact, cos (x ± Ni) = 
— cos x for any odd integral value of IV. Therefore, the phase can be chosen as ±Nx where N is 
any convenient odd integer. 
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Using the above values we could plot amplitude and phase spectra. However, to simplify 
our task in this special case, we will allow amplitude C n to take on negative values so 
that we do not need a phase of -7r to account for the sign. In other words, phases of all- 
components are zero, so we can discard the phase spectrum and manage with only the 
amplitude spectrum, as shown in Fig. 3.8b. Observe that this simpler procedure involves 
no loss of information and that the amplitude spectrum in Fig. 3.8b has the complete 
information about the Fourier series in (3.61). Therefore , whenever all sine terms vanish 
(b n = 0), it is convenient to allow C n to take on negative values. This procedure permits 
the spectral information to be conveyed by a single spectrum — the amplitude spectrum. 
Because C„ can be positive as well as negative, the spectrum is called the amplitude 
spectrum rather than the magnitude spectrum. B 



/ 1/2 r 3/2 

2 At sin mrt dt + / 2A(1 - t) sin nirtdt 

1/2 J 1/2 


The detailed evaluation of these integrals yields 



n even 

n =1, 5, 9, 13, 
n =3, 7, 11, 15, 


(3.62a) 


(3.62b) 
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Fig. 3.9 A triangular periodic signal and its Fourier spectra. 


Therefore 

/(f) = ^ jsin 7 rt— i sin 3/rf + -L sin 5?rt - sin 7/rf H j (3.63) 

In order to plot Fourier spectra, the series must be converted into compact trigonometric 
form as in Eq. (3.54). In this case, sine terms are readily converted into cosine terms with 
a suitable phase shift. For example, 

± sin kt = cos (kt T 90°) 

Using this identity, Eq. (3.63) can be expressed as 

/(f) = ^ cos ( 7ri “ 90 °) + \ cos ( 3,rt + 90 °) + ^5 cos ( 5nt _ 90 °) 

■fi cos (7/rf + 90°) + • • • (3-64) 

In this series all the even harmonics are missing. The phases of odd harmonics alternate 
from -90° to 90°. Figure 3.9 shows amplitude and phase spectra for /(f). ■ 

3.4-1 The Effect of Symmetry 

The Fourier series for the periodic signal in Fig. 3.7b (Example 3.3) consists 
of sine and cosine terms, but the series for the signal /(f) in Fig. 3.8a (Example 
3.4) consists of cosine terms only, and the series for the signal /(f) in Fig. 3.9a 
(Example 3.5) consists of sine terms only. This observation is no accident. We can 
show that the Fourier series of any even periodic function /(f) consists of cosine 
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terms only and the series for any odd periodic function /(f) consists of sine terms 
only. Moreover, because of symmetry (even or odd), the information of one period 
of /(f) is implicit in only half the period, as seen in Figs. 3.8a and 3.9a. In these 
cases, knowing the signal over a half period and what kind of symmetry (even or 
odd) is present, we can determine the signal waveform over a complete period. For 
this reason, the Fourier coefficients in these cases can be computed by integrating 
over only half the period rather than a complete period. To prove this result, recall 
that 


1 

an — — 
To j 

/•To/2 

/ f(t)dt 

'-To/2 

(3.65a) 

2 

an ~ To u 

/•To/2 

/ / (f) cos nuiot dt 

'-T 0 /2 

(3.65b) 

To, 

/•To/2 

/ /(f) sin nuiot dt 

-To/2 

(3.65c) 


Recall also that cos nuiot is an even function and sin nuiot is an odd function of 
f. If /(f) is an even function of f, then /(f) cos nuiot is also an even function and 
/(f) sin nuiot is an odd function of t (see Sec. 1.5-1). Therefore, use of Eqs. (1.33a) 
and (1.33b) yields 

2 /•7’o/S 

“o = — / /(f) df (3.66a) 

To Jo 

4 r 1 0/2 

a n — — / /(f) cos nuiot dt (3.66b) 

To Jo 

b n =0 (3.66c) 

Similarly, if /(f) is an odd function of f, then /(f) cos nuiot is an odd function of f 
and /(f) sin nuiot is an even function of f. Therefore 

no = “n = 0 (3.67a) 

4 /■T 0/2 

b n = — / f (t) sin nuiot dt (3.67b) 

To Jo 

Observe that, because of symmetry, the integration required to compute the coeffi- 
cients need be performed over only half the period. 

If a periodic signal /(f), shifted by half the period, remains unchanged except 
for a sign — that is, if 

/ (t - f ) = -/(«) 

the signal is said to have a half-wave symmetry. We can demonstrate that in 
a signal with a half-wave symmetry, all the even-numbered harmonics vanish (see 
Prob. 3.4-7). The signal in Fig. 3.9a is a clear example of such a symmetry. This 
half-wave symmetry is also present in the signal in Fig. 3.8a but in a subtle form. 
The half-wave symmetry becomes obvious, however, when we subtract the dc com- 
ponent 0.5 from this signal. Note that this signal has a dc component 0.5 and only 
odd harmonics. 
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Fig. 3.10 Periodic signals for Exercise E3.6. 


A Exercise E3.6 

Find the compact trigonometric Fourier series for the periodic signals depicted in Figs. 3.10a 
and 3.10b. Sketch their amplitude and phase spectra. Allow C n to take on negative values if f> n — 0 
so that the phase spectrum can be eliminated. Hint: Use Eqs. (3.66) and (3.67) for symmetry. 
Answers: 


(a) f(t) = ^ (cos 7rt — A cos 2-nt + | cos 37 rt — ^ cos 47 rf H ) 

= j + j^cos (trf - 7r) + j cos 2nt + i cos ( 37 ti - jr) H J 

(b) /(f) = 24 (sin 7 r t — 5 sin 27rf + A sin 37 rt — A sin 4rrt H ] 

= 24 [cos (?rf - 90°) + 5 cos ( 2 trf + 90°) + | cos ( 37 rt - 90°) + • • •] V 


3.4-2 Determining the Fundamental Frequency and Period 

We have seen that every periodic signal can be expressed as a sum of sinusoids 
of a fundamental frequency u>o and its harmonics. One may ask whether a sum 
of sinusoids of any frequencies represents a periodic signal. If so, how does one 
determine the period? Consider the following three functions: 

/i(t) = 2 + 7cos (jt + 0i) + 3 cos (ft + #2) + 5 cos (| t + 63 ) 

/2(f) = 2 cos (2 1 + ffi) + 5 sin (xi + #2) 

/3(f) = 3sin ^3t/2 f + d'j + 7 cos (^V2t + <j>^j 

Recall that every frequency in a periodic signal is an integral multiple of the 
fundamental frequency uo- Therefore, the ratio of any two frequencies is of the form 
m/n where m and n are integers. This means that the ratio of any two frequencies 
is a rational number. When the ratio of two frequencies is a rational number, they 
are said to be harmonically related. 

The largest positive number of which all the frequencies are integral multiples 
is the fundamental frequency. The frequencies in the spectrum of fi(t) are |, |, 
and g (we do not consider dc). The ratios of the successive frequencies are | and 
*, respectively. Because both these numbers are rational, all the three frequencies 
in the spectrum are harmonically related and the signal /i(t) is periodic. The largest 
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#>1 

f 

number of which A |, and g are integral multiples is g.f Moreover, 3(g) =( A, 
4 (g) = §> and 7(g) = Therefore the fundamental frequency is g. The thlree 
frequencies in the spectrum are the third, fourth, and seventh harmonics. Observe 
that the fundamental frequency component is absent in this Fourier series. 

The signal f 2 (t ) is not periodic because the ratio of two frequencies in the 
spectrum is 2/?r, which is not a rational number. The signal /3(f) is periodic because 
the ratio of frequencies 3 v^2 and 6\/2 is 1/2, a rational number. The greatest 
common divisor of 3\/2 and 6\/2 is 3\/2. Therefore the fundamental frequency 
uio = 3\/2, and the period 


To 


A Exercise E3.7 

Determine whether the signal 


2 n 

(3V2) 



f(t) = cos (| t + 30°) + sin (| t + 45°) 

is periodic. If it is periodic, find the fundamental frequency and the period. What harmonics are 
present in /(<)? 

Answer: Periodic with w 0 = ^ and period To = 15 tt. The fifth and sixth harmonics. v 


3.4-3 The Role of Amplitude and Phase Spectra in Wave Shaping 


The trigonometric Fourier series of a signal f(t) shows explicitly the sinusoidal 
components of f(t). We can synthesize /(f) by adding the sinusoids in the spectrum 
of f{t). To synthesize the square-pulse periodic signal /(f) of Fig. 3.8a, we add 
successive harmonics in its spectrum step by step and observe the similarity of the 
resulting signal to f(t). The Fourier series for this function as found in Example 
3.4 is 


/(f) — - H — ( cos t - - cos 3t + \ cos 5f - ^ cos 7f + • • 

2 7r ^ 3 5 7 J 

We start the synthesis with only the first term in the series (n = 0), a constant A 
(dc); this is a gross approximation of the square wave, as shown in Fig. 3.11a. In the 
next step we add the dc ( n = 0) and the first harmonic (fundamental), which results 
in a signal shown in Fig. 3.11b. Observe that the synthesized signal somewhat 
resembles /(f). It is a smoothed-out version of /(f). The sharp corners in /(f) 
are not reproduced in this signal because sharp corners indicate rapid changes and 
their reproduction requires rapidly varying (that is, higher frequency) components, 
which are excluded. Figure 3.11c shows the sum of dc, first, and third harmonics 
(even harmonics are absent). As we increase the number of harmonics progressively, 
as illustrated in Figs. 3. lid (sum up to the fifth harmonic) and 3. lie (sum up to 

fThe largest number of which §J, • • • , are integral multiples is the ratio of the GCF 
(greatest common factor) of the numerators set ( 01 , 02 , a m ) to the LCM (least common 
multiple ) of the denominator set (in, 62 , • • ■ , b m ). For instance, for the set (§, 6, 2), the GCF 
of the numerator set (2,6,2) is 2; the LCM of the denominator set (3,7,1) is 21. Therefore, -A is 
the largest number of which |, f , and 2 are integral multiples. 
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(c) 


(d) 


(e) 

Fig. 3.11 Synthesis of a square pulse periodic signal by successive addition of its har- 
monics. 

the nineteenth harmonic), the edges of the pulses become sharper and the signal 
resembles /(t) more closely. 

Asymptotic Rate of Amplitude Spectrum Decay 

The amplitude spectrum indicates the amounts (amplitudes) of various fre- 
quency components of f(t). If /(f) is a smooth function, its variations are less 
rapid. Synthesis of such a function requires predominantly lower-frequency sinu- 
soids and relatively small amounts of rapidly varying (higher frequency) sinusoids. 
The amplitude spectrum of such a function would decay swiftly with frequency. To 
synthesize such a function we require fewer terms in the Fourier series for a good 
approximation. In contrast, a signal with sharp changes, such as jump discontinu- 
ities, contains rapid variations and its synthesis requires a relatively large amount of 
high-frequency components. The amplitude spectrum of such a signal would decay 
slowly with frequency, and to synthesize such a function, we require many terms 
in its Fourier series for a good approximation. The square wave /(t) is a discon- 
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tinuous function with jump discontinuities, and therefore its amplitude spectrum 
decays rather slowly, as l/n [see Eq. (3.61)]. On the other hand, the triangular 
pulse periodic signal in Fig. 3.9a is smoother because it is a continuous function (no 
jump discontinuities). Its spectrum decays rapidly with frequency as l/n 2 [see Eq. 
(3.63)]. 

We can show 8 that if the first k — 1 derivatives of a periodic signal /(t) are 
continuous and the kt h derivative is discontinuous, then its amplitude spectrum C n 
decays with frequency at least as rapidly as 1 /n k+1 . This result provides a simple 
and useful means for predicting the asymptotic rate of convergence of the Fourier 
series. In the case of the square- wave signal (Fig. 3.8a), the zero-th derivative of the 
signal (the signal itself) is discontinuous, so that k = 0. For the triangular periodic 
signal in Fig. 3.9a, the first derivative is discontinuous; that is, k = 1. For this 
reason, the spectra of these signals decay as l/n and l/n 2 , respectively. 



Fig. 3.12 Role of the phase spectrum in shaping a periodic signal. 


The Role of the Phase Spectrum 

The relationship between the amplitude spectrum and the waveform /(f) is 
reasonably clear. The relationship between the phase spectrum and the periodic 
signal waveform is not so direct, however. Yet the phase spectrum plays an equally 
important role in waveshaping. We can explain this role by considering a signal /(f) 
that has rapid changes such as jump discontinuities. To synthesize an instantaneous 
change at a jump discontinuity, the phases of the various sinusoidal components in 
its spectrum must be such that all (or most) of the harmonic amplitudes will have 
one sign before the discontinuity and the opposite sign after the discontinuity. This 
will result in a sharp change in /(f) at the point of discontinuity. We can verify 
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this assertion in any waveform with jump discontinuity. Consider, for example, the 
sawtooth waveform in Fig. 3.10b. This waveform has a discontinuity at t = 1. The 
Fourier series for this waveform as given in Exercise E3.6b is 


/(f) = ^ [cos (ir t — 90°) + ^ cos (27rf + 90°) + | cos (3-7rt — 90°) 

+ i cos (4irt + 90°) + • • •] (3.68) 

Figure 3.12 shows the first three components of this series. The phases of all the 
(infinite) components are such that their amplitudes are positive just before t = 1 
and turn negative just after t = 1, the point of discontinuity. The same behavior 
is also observed at t = —1, where similar discontinuity occurs. This sign change 
in all the harmonics adds up to produce the jump discontinuity. In achieving a 
sharp change in the waveform, the role of the phase spectrum is crucial. If we try 
to reconstruct this signal while ignoring the phase spectrum, the result will be a 
smeared and spread-out waveform. In general the phase spectrum is just as crucial 
in determining the waveform as is the amplitude spectrum. The synthesis of any 
signal f(t) is achieved by using a proper combination of amplitudes and phases of 
various sinusoids. This unique combination is the Fourier spectrum of f(t). 

Fourier Synthesis of Discontinuous Functions: The Gibbs Phenomenon 

Fig. 3.11 shows the square function /(f) and its approximation by a truncated 
trigonometric Fourier series that includes only the first n harmonics for n=l, 3, 5, 
and 19. The plot of the truncated series approximates closely the function /(f) as 
n increases, and we expect that the series will converge exactly to /(f) as n — > oo. 
This is because, as shown in Sec. 3.3, the energy of the difference between /(f) and 
its Fourier series over one period (the error energy) — * 0 as n — * oo. Yet the curious 
fact, as seen from Fig. 3.11, is that even for large n, the truncated series exhibits 
an oscillatory behavior and an overshoot approaching a value of about 9% in the 
vicinity of the discontinuity at the first peak of oscillation. Regardless of the value of 
n, the overshoot remains at about 9%. This strange behavior appears to contradict 
the mathematical result derived in Sec. 3.3-2 that the error energy — > 0 as n — » oo. 
In fact, this apparent contradiction puzzled many people at the turn of the century. 
Josiah Willard Gibbs gave a mathematical explanation of this behavior (now called 
called the Gibbs phenomenon). We can reconcile the two conflicting notions by 
observing from Fig. 3.11 that the frequency of oscillation of the synthesized signal 
is n, so the width of the spike with 9% overshoot is approximately l/2n. As we 
increase n, the number of terms in the series, the frequency of oscillation increases 
and the spike width l/2n diminishes. As n — * oo, the error energy — > 0 because the 
error consists mostly of the spikes, whose widths — * 0. Therefore, as n — ► oo, the 
corresponding Fourier series differs from /(f) by about 9% at the immediate left 
and right of the points of discontinuity, and yet the error energy — > 0. 

When we use only the first n terms in the Fourier series to synthesize a signal, 
we are abruptly terminating the series, giving a unit weight to the first n harmonics 
and zero weight to all the remaining harmonics beyond n. This abrupt termination 
of the series causes the Gibbs phenomenon in synthesis of discontinuous functions. 
More discussion on the Gibbs phenomenon, its ramifications, and cure appear in 
section 4.9. 
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Fig. 3.13 Fourier Synthesis of a continuous signal using first 19 harmonics. 


Gibbs phenomenon is present only when there is a jump discontinuity in /(f). 
When a continuous function }{t) is synthesized using the first n terms of the Fourier 
series, the synthesized function approaches /(f) for all t as n -* oo. No Gibbs 
phenomenon appears. Note the absence of the Gibbs phenomenon in Fig. 3.13, 
where a continuous signal is synthesized using first 19 harmonics. Compare the 
similar situation for a discontinuous signal in Fig. 3.11. 

A Exercise E3.8 

By inspection of signals in Figs. 3.7b, 3.10a, and 3.10b, determine the asymptotic rate of 
decay of their amplitude spectra. 

Answer: 1/n, 1/n 2 , and 1 /n, respectively. V 

A Historical Note on the Gibbs Phenomenon 

Normally speaking, troublesome functions with strange behavior are invented 
by mathematicians, although we rarely see such oddities in practice. In the case 
of the Gibbs phenomenon, however, the tables were turned. A rather puzzling 
behavior was observed in such a mundane object as a mechanical wave synthesizer, 
and then well-known mathematicians of the day were dispatched on the scent of it 
to discover its hide-out. 

Albert Michelson (of Michelson-Morley fame) was an intense, practical man 
who developed ingenious physical instruments of extraordinary precision, mostly in 
the field of optics. In 1898 he developed an instrument (the harmonic analyzer) 
which could compute the first 80 coefficients of the Fourier series of a signal /(f) 
specified by any graphical description. The harmonic analyzer could also be used 
as a harmonic synthesizer, which could plot a function f(t) generated by summing 
the first 80 harmonics (Fourier components) of arbitrary amplitudes and phases. 
This instrument therefore had the ability of self-checking its operation by analyzing 
a signal /(() and then adding the resulting 80 components to see whether the sum 
yielded a close approximation of /(f). 

Michelson found that the instrument checked very well with most of signals 
analyzed. However, when he tried a discontinuous function, such as a square wave,) 
a curious behavior was observed. The sum of 80 components showed oscillatory be- 
havior (ringing) with an overshoot of 9% in the vicinity of the points of discontinuity. 
Moreover, this behavior was a constant feature regardless of the number of terms 

f Actually it was a periodic sawtooth signal 
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Albert Michelson (left) and Willard J. Gibbs (right). 


added. Larger number of terms made the oscillations proportionately faster, but 
regardless of the number of terms added the overshoot remained 9%. This puzzling 
behavior caused Michelson to suspect some mechanical defect in his synthesizer. He 
wrote about his observation in a letter to Nature (December 1898). Josiah Willard 
Gibbs, an eminent mathematical physicist (inventor of vector analysis), and a pro- 
fessor at Yale, investigated and clarified this behavior for a sawtooth periodic signal 
in a letter to Nature. 9 Later, in 1906, Bocher generalized the result for any function 
with discontinuity. 10 It was Bocher who gave the name Gibbs phenomenon to this 
behavior. Gibbs showed that the peculiar behavior in the synthesis of a square wave 
was inherent in the behavior of the Fourier series because of nonuniform convergence 
at the points of discontinuity. 

This, however, is not the end of the story. Both Bocher and Gibbs were under 
the impression that this property had remained undiscovered until Gibbs’s letter 
in 1899. It is now known that the Gibbs phenomenon had been observed in 1848 
by Wilbraham of Trinity College, Cambridge, who clearly saw the behavior of the 
sum of the Fourier series components in the periodic sawtooth signal investigated 
by Gibbs. 11 Apparently, this work was not known to most people, including Gibbs 
and Bocher. 

3.5 Exponential Fourier Series 

It is shown in Appendix 3C that the set of exponentials e-’ na ' ot (n = 0, ±1, ±2, . . .) 
is orthogonal over any interval of duration To = 27t/ujo, that is, 


r 

r ( o 

m n 


J e 3mu,ot (e- inoJot ydt = J 

I dt = J 


(3.69) 

To { To 

m = n 
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Moreover, this set is a complete set. 6 ’ 7 From Eqs. (3.44) and (3.45), it follows 

that a signal f(t) can be expressed over an interval of duration T 0 seconds as an 

exponential Fourier series 

OO 

/(*) = Y D ne jnulot (3.70) 

77. = — OO 

where [see Eq. (3.45)] 

D n = ^r f(t)e- jnUot dt (3.71) 

The exponential Fourier series is basically another form of the trigonometric Fourier 
series. Each sinusoid of frequency u > can be expressed as a sum of two exponentials 
and e ■ v ~ t . This results in the exponential Fourier series consisting of compo- 
nents of the form e jnUot with n varying from -oo to oo. The exponential Fourier 
series in Eq. (3.70) is periodic with period To. 

In order to see its close connection with the trigonometric series, we shall 
rederive the exponential Fourier series from the trigonometric Fourier series. A 
sinusoid in the trigonometric series can be expressed as a sum of two exponentials 
using Euler’s formula: 

C n COS ( nu 0 t + S n ) = ~ + j(na>ot+0 n )j 

e inu 0 t 

On 

= D n e jn “°* + D_ n e -jnoJot (3.72) 

The compact trigonometric Fourier series of a periodic signal }{t) is given by 

OO 

/(t) = Co + Y, Cn cos ( nu>ot + 6 n ) 

n = 1 

Use of Eq. (3.72) in the above equation (and letting Co = Do) yields 

OO 

f(t) = D 0 + Y D n e jnuat + D- n e- imjot 

n~ 1 
oo 

= Y DnC j ™ 0t 

Tl — — OO 

which is precisely Eq. (3.70) derived earlier. Observe the compactness of expressions 
(3.70) and (3.71) and compare them to expressions corresponding to the trigono- 
metric Fourier series. These two equations clearly demonstrate the principle virtue 
of the exponential Fourier series. First, the form of the series is more compact. 
Second, the mathematical expression for deriving the coefficients of the series is 
also compact. The exponential series is far more convenient to handle than the 
trigonometric one. In the system analysis also, the exponential form proves more 
convenient than the trigonometric form. For these reasons we shall use exponential 
(rather than trigonometric) representation of signals in the rest of the book. 
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The connection between the trigonometric and exponential series coefficients 
is clear in Eq. (3.72): 

D„ = \C n e ie " 

D- n = JC„e-^ (3.73) 

The connection between the trigonometric and the exponential Series also becomes 
clear when we substitute e” = cos u>t — j sin ut in Eq. (3.71) to obtain 


Dn — ^( a n 3 bn) 


Example 3.6 

Find the exponential Fourier series for the signal in Fig. 3.7b (Example 3.3). 
In this case To = tt, uq = 2tt/To = 2, and 


<p(t) = Dne * 


t °L 

=i r. 

T Jo 

r, 

Wo 


dt 


,-(^+;2n)£ 


1 e -0+j2n)t 

ji- (| + j2n) 

0.504 
1 + jAn 


°° 1 
W) = 0.504 Y, YT' 


^ ^ 1 + jin 

n= — oo 

= 0.504 [1 + + x^e** + ■ • • 

+ + x^e- j4t + x^e- 464 + • ■ •] (3.76b) 

Observe that the coefficients D„ are complex. Moreover, D n and D- n are conjugates as 
expected [see Eq. (3.73)]. H 

3.5-1 Exponential Fourier Spectra 

In exponential spectra, we plot coefficients D n as a function of oi. But since 
D n is complex in general, we need two plots: the real and the imaginary parts of 
D n , or the magnitude and the angle of D n . We prefer the latter because of its 
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close connection to the amplitudes and phases of corresponding components of the 
trigonometric Fourier series. We therefore plot |D„| vs. ui and ZD n vs. w. This 
requires that the coefficients D n be expressed in polar form as \D n \e j ^° n . 
Comparison of Eqs. (3.51a) and (3.71) (for n = 0) shows that 



Do = do = Cq 

(3.77a) 

Equation (3.73) shows that, for real /(f), the twin coefficients D n 
conjugates, and 

and £>_ n are 


\D n \ — \D— n \ — — C n ti / 0 

(3.77b) 


= 9n and ZD_ n = -6 n 

(3.77c) 

Thus, 

D n = \D n \e je " and D_„ = 

(3.77d) 


where |£> n | are the magnitudes and LD n are the angles of various exponential 
components. From Eqs. (3.77) it follows that the magnitude spectrum (|Z) n | vs. ui) 
is an even function of u> and the angle spectrum {LD n vs. ui) is an odd function of 
uj when f(t) is a real signal. 

For the series in Example 3.6 [Eq. (3.76b)], for instance, 

D 0 = 0.504 

D\ = = 0.122e~ J ' 75 ’ 96 ° =*> |Di| = 0.122, LD X = -75.96° 

D-i = = 0.122e-’ 75,96 ° =4- |D_i| = 0.122, LD- X = 75.96° 

and 

_ 0.504 R9 a -o 

D 2 = z—— = 0.0625e - - 782 ' 87 => \D 2 \ = 0.0625, ZD 2 = -82.87° 

1 TJO 

__ 0.504 -an Q 7 o 

D- 2 = - _ — = 0.0625e j82 ' 87 =4- ]Z?_ 2 | = 0.0625, Z£>_ 2 = 82.87° 

and so on. Note that D n and are conjugates, as expected [see Eqs. (3.77)]. 

Figure 3.14 shows the frequency spectra (amplitude and angle) of the exponen- 
tial Fourier series for the periodic signal <p{t) in Fig. 3.7b. 

We notice some interesting features of these spectra. First, the spectra exist 
for positive as well as negative values of u (the frequency). Second, the amplitude 
spectrum is an even function of u> and the angle spectrum is an odd function of 
01 . Finally, we see a close connection between these spectra and the spectra of the 
corresponding trigonometric Fourier series for <p(t) (Figs. 3.7c and d). 

What is a Negative Frequency? 

The existence of the spectrum at negative frequencies is somewhat disturbing 
because, by definition, the frequency (number of repetitions per second) is a positive 
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T 
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Fig. 3.14 Exponential Fourier spectra for the signal in Fig. 3.7a. 

quantity. How do we interpret a negative frequency? Using a trigonometric identity, 
we can express a sinusoid of a negative frequency —wo as 

cos (-wot + 6) = cos (wot - 9) 

This equation clearly shows that the frequency of a sinusoid cos (wot + 6) is |wo|, 
which is a positive quantity. The same conclusion is reached by observing that 

e ±;W _ cos UQt ± j s i n uo t 

Thus, the frequency of exponentials e ± ? u ’°* is indeed |wo|. How do we then interpret 
the spectral plots for negative values of w? A healthier way of looking at the situa- 
tion is to say that exponential spectra are a graphical representation of coefficients 
D n as a function of w. Existence of the spectrum at w = -nw 0 is merely an indi- 
cation of the fact that an exponential component e~i nuat exists in the series. We 
know that [see Eq. (3.72)] a sinusoid of frequency nw 0 can be expressed in terms of 
a pair of exponentials e in ^ at and e _ -i nu ' ot . 

Equation (3.77) shows the close connection between the trigonometric spectra 
(C n and 8 n ) with exponential spectra (|D n | an d ZD n ). The dc components Do an< i 
Co are identical in both spectra. Moreover, the exponential amplitude spectrum 
\D n \ is half of the trigonometric amplitude spectrum C n for n > 1. The exponen- 
tial angle spectrum ZD n is identical to the trigonometric phase spectrum 9 n for 
n > 0. We can therefore produce the exponential spectra merely by inspection of 
trigonometric spectra, and vice versa. The following example demonstrates this 
feature. 

I Example 3.7 

The trigonometric Fourier spectra of a certain periodic signal f{t) are shown in Fig. 
3.15a. By inspecting these spectra, sketch the corresponding exponential Fourier spectra 
and verify your results analytically. 
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Fig. 3.15 Spectra for Example 3.7. 

The trigonometric spectral components exist at frequencies 0,3,6, and 9. The expo- 
nential spectral components exist at 0, 3, 6, 9 and -3, -6, -9. Consider first the amplitude 
spectrum. The dc component remains unchanged; that is, Do = Co — 16. Now |D„| is 
an even function of w and |D n | = |D_„| = C„/2. Thus, all the remaining spectrum \D n \ 
for positive n is half the trigonometric amplitude spectrum C„, and the spectrum |D„| for 
negative n is a reflection about the vertical axis of the spectrum for positive n, as shown 
in Fig. 3.15b. 

The angle spectrum ZD„ = $„ for positive n and is -9 n for negative n, as depicted 
in Fig. 3.15b. We shall now verify that both sets of spectra represent the same signal. 

Signal f(t) whose trigonometric spectra are shown in Fig. 3.15a, has four spectral 
components of frequencies 0, 3, 6, and 9. The dc component is 16. The amplitude and 
the phase of the component of frequency 3 are 12 and - J, respectively. Therefore, this 
component can be expressed as 12cos(3t — f). Proceeding in this manner, we can write 
the Fourier series for f(t) as 

f(t) = 16 + 12cos (3 1 — f) + 8 cos (6f - |) + 4cos (9t - \ ) 

Consider now the exponential spectra in Fig. 3.15b. They contain components of 
frequencies 0 (dc), ±3, ±6, and ±9. The dc component is Do = 16. The component 
e (frequency 3) has magnitude 6 and angle — ~ . Therefore, this component strength is 
6e -3 7, and it can be expressed as . Similarly, the component of frequency —3 

is (6e-’T Proceeding in this manner, /(t), the signal corresponding to the spectra 

in Fig. 3.15b, is 

f(t) = 16 + [6e“ J V 3t + 6e^e _j3t ] + [4e“ J '* e i6t + 4e J '?e*-’ 6t ] + [2e~ j V 9t + 2e j Te~ j9t ] 

= 16 + 6[e i(3t -t ) + e- j(3t -f ) ] +4 > + e -A 6 '-*)] + 2 + e -A 9 ‘-f>] 

= 16 + 12 cos (3t — j) + 8 cos (6 1 - f ) + 4 cos (9t - j) 


Clearly both sets of spectra represent the same periodic signal. 
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Bandwidth of a Signal 

The difference between the highest and the lowest frequencies of the spectral 
components of a signal is the bandwidth of the signal. The bandwidth of the 
signal whose exponential spectra are shown in Fig. 3.15b is 9 (in radians). The 
highest and lowest frequencies are 9 and 0 respectively. Note that the component of 
frequency 12 has zero amplitude and is nonexistent. Moreover, the lowest frequency 
is 0, not -9. Recall that the frequencies (in the conventional sense) of the spectral 
components at w = —3, —6, and —9 in reality are 3, 6, and 9.f The bandwidth can 
be more readily seen from the trigonometric spectra in Fig. 3.15a. 


■ Example 3.8 

Find the exponential Fourier series and sketch the corresponding spectra for the 
impulse train Sr 0 (t) depicted in Fig. 3.16a. From this result sketch the trigonometric 
spectrum and write the trigonometric Fourier series for 6xb (*)- 
The exponential Fourier series is given by 


St 0 (<) = D n e r 


2ir 




Choosing the interval of integration (-f^, ^) and recognizing that over this interval 
6r 0 (t) = 6(t), 

i r T < o/ 2 


-ks: 


In this integral the impulse is located at t = 0. From the sampling property (1.24a), 
the integral on the right-hand side is the value of e~ inulot at t = 0 (where the impulse is 
located). Therefore 

Dn = jr (3.79) 

Substitution of this value in Eq. (3.78) yields the desired exponential Fourier series 


OO 

STM = ¥n £ 


Equation (3.79) shows that the exponential spectrum is uniform ( D n = 1/To) for all the 
frequencies, as shown in Fig. 3.16b. The spectrum, being real, requires only the amplitude 
plot. All phases are zero. 

To sketch the trigonometric spectrum, we use Eq. (3.77) to obtain 
Co = Do = y q 


C n = 2\D n \ = ; 


n = 1,2,3,- 


f Some authors do define bandwidth as the difference between the highest and the lowest (negative) 
frequency in the exponential spectrum. The bandwidth according to this definition is twice that 
defined here. In reality, this definition defines not the signal bandwidth but the spectral width 
(width of the exponential spectrum of the signal). 




Fig. 3.16 Impulse train and its Fourier spectra. 

Figure 3.16c shows the trigonometric Fourier spectrum. From this spectrum we can express 
Sr„(t) as 

^To(t) = — [1 + 2(cos uot + cos 2u>ot + cos 3w 0 t + •■■)] wo = ~ (3.81) 

Effect of Symmetry in Exponential Fourier Series 

When f(t) has an even symmetry, b n = 0, and from Eq. (3.74), D n = a n / 2, 
which is real (positive or negative). Hence, LD n can only be 0 or ±tt. Moreover, we 
may compute D n — a n /2 using Eq. (3.66b), which requires integration over a half 
period only. Similarly, when /(t) has an odd symmetry, a n = 0, and D n = -jb n /2 
is imaginary (positive or negative). Hence, lD n can only be 0 or ±ir/2. Moreover, 
we may compute D n — -jb n /2 using Eq. (3.67b), which requires integration over 
a half period only. Note, however, that in the exponential case, we are using the 
symmetry property indirectly by finding the trigonometric coefficients. We cannot 
apply it directly to find D n from eq. (3.71). 

A Exercise E3.9 

The exponential Fourier spectra of a certain periodic signal /(«) are shown in Fig. 3.17. 
Determine and sketch the trigonometric Fourier spectra of f(t) by inspection of Fig. 3.17. Now 
write the (compact) trigonometric Fourier series for f(t). 

Answer: /(*) = 4 + 6cos (3( - |) + 2cos (6t - + 4cos (9t - f ) V 

A Exercise E3.10 

Find the exponential Fourier series and sketch the corresponding Fourier spectrum D n vs. u> 
for the full-wave rectified sine wave depicted in Fig. 3.18. 

Answer: oo 

'<*>-; Enh'""’ v 
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Fig. 3.17 Fourier spectra for the signal in Exercise E3.9. 
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Fig. 3.18 A full-wave rectified sine wave in Exercise E3.10. 


3.5-2 Parseval’s Theorem 

The trigonometric Fourier series of a periodic signal / (t) is given by 

OO 

f(t) = ^0 + ^ C n cos (nco 0 t + 0 n ) 

n= 1 

Every term on the right-hand side of this equation is a power signal. Moreover, 
all the Fourier components on the right-hand side are orthogonal over one period. 
Hence, the power of f(t) is equal to the power of the sum of all the sinusoidal 
components on the right-hand side. We already demonstrated in Example 1.2 that 
the power of the sum of sinusoids is equal to the sum of the powers of all the 
sinusoids. Moreover, the power of a sinusoid of amplitude C n is C n / 2 regardless 
of the values of its frequency phase, and the power of a dc term Co is Co • Thus, 
the power of f(t) is given by 

i 00 

Pf = co 2 + lY2 c " (3 - 82) 

1 n= 1 

This result, which is an alternate form of Eq. (3.42), is the Parseval’s theorem 
(for Fourier series). It states that the power of a periodic signal is equal to the sum 
of the powers of its Fourier components. 

We can apply the same argument to the exponential Fourier series, which is 
also made up of the orthogonal components. Hence, the power of a periodic signal 
f(t) can be expressed as a sum of the powers of its exponential components. In 
Eq. (1.5d), we showed that the power of an exponential De juJot is \D 2 \. Using this 
result we can express the power of a periodic signal f(t ) in terms of its exponential 
Fourier series coefficients as 

OO 

Pf= E l^nl 2 

71= — OO 


(3.83a) 
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For a real f(t), |D_„| = |D n j. Therefore 

OO 

P f = D 0 2 + 2Y^\D n \ 2 (3.83b) 

71=1 

I Example 3.9 

The input signal to an audio amplifier of gain 100 is given by x(t) = 0.1 cos wo t. 
Hence, the output is a sinusoid 10 cos wot. However, the amplifier, being nonlinear at 
higher amplitude levels, clips all amplitudes beyond ±8 volts as shown in Fig. 3.19a. We 
shall determine the harmonic distortion incurred in this operation. 

The output y(t) is the clipped signal in Fig. 3.19a. The distortion signal y d (t), shown 
in Fig. 3.19b, is the difference between the undistorted sinusoid 10 cos u 0 t and the output 
signal y{t). The signal y d (t), whose period is T 0 [the same as that of y(t)] can be described 
I over the first cycle as 

( 10 cos w 0 t -8 |t| < 0.10242o 

10 cos w 0 t + 8 - 0.1024T o < |t| < ^ + 0.10247b 

0 everywhere else 

Observe that y d (t) is an even function of t and its mean value is zero. Moreover, b n = 0, 
and C n = a n . Hence, its Fourier series can be expressed as 

f OO 

y d (t) = Cn COS nuot 

n= 1 

As usual, we can compute the coefficients C n (which is equal to a n ) by integrating 
y d (t) cos nu 0 t over one cycle (and then dividing by 2 /To). Because y d (t) has even sym- 
metry, we can find a n by integrating the expression over half cycle only using Eq. (3.66b). 
The straightforward evaluation of the appropriate integral yields! 

fin addition, y d (t) exhibits half-wave symmetry (see Prob. 3.4-7), where the second half cycle is 
the negative of the first half cycle. Because of this property, all the even harmonics vanish, and 
the odd harmonics can be computed by integrating the appropriate expressions over the first half 
cycle only (from -7o/4 to To/4) and doubling the resulting values. Moreover, because of even 
symmetry, we can integrate the appropriate expressions over 0 to T 0 /4 (instead of from -T 0 /4 to 
T 0 /4) and double the resulting values. In essence, this allows us to compute C n by integrating the 
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n odd 
n even 


Computing the coefficients Ci, C 2 , C 3 , ■ ■ ■ from this expression, we can write 


yi(t) = 1.04 cos wot + 0.733 cos 3wo t + 0.311 cos 5wot H 


Computing Harmonic Distortion 

In this case, we can compute the amount of distortion in the output signal by com- 
puting the power of the distortion component yd(t)- Because yd(t) is an even function of 
t and because the power in the first half cycle is identical to the power in the second half 
cycle, we can compute the power by averaging the energy over a quarter cycle. Thus 


1 r To/ 2 

Py<i ~ jT / y d (0 ^ 

io J-T0/2 

1 r To/i 

= t^L Vd2(t)dt 

. /»0.1024 T 0 

= — / (10 cos wot - 8) 2 dt 

T ° Jo 

0.865 

The power of the desired signal 10 cos wot is (10) 2 /2 = 50. Hence, the total harmonic 
distortion is 

Dtot = x 100 = 1.73% 

50 

The powers of the first harmonic and the third harmonic components of yi(t) are 
(1.04) 2 /2 = 0.5408 and (0.726) 2 /2 = 0.2635, respectively. Hence, the first harmonic 
and the third harmonic distortions are 

= 05408 x 1Q0 = 10g% and Ds = 2^35 x 10Q = Q 52?% B 
50 50 


3.6 Numerical Computation of D n 

We can compute D n numerically using the DFT (the discrete Fourier transform 
discussed in Sec. 5.2), which uses the samples of a periodic signal f(t) over one 
period. The sampling interval is T seconds. Hence, there are No = T 0 /T number 
of samples in one period T 0 . To find the relationship between D n and the samples 
of /(t), consider Eq. (3.71) 

expression over the quarter cycle only and then quadrupling the resulting values. Thus 

g /'O.1024T0 

C n = a n = — / [10 cos coot - 8] cos moot dt 

T ° Jo 
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(3.84) 


JV 0 = -=T. Ro = w 0 T = — (3.85) 

1 rv 0 

In practice, it is impossible to make T — ♦ 0 in computing the right-hand side 
of Eq. (3.84). We can make T small, but not zero, which will cause the data to 
increase without limit. Thus, we shall ignore the limit on T in Eq. (3.84) with the 
implicit understanding that T is reasonably small. Nonzero T will result in some 
computational error, which is inevitable in any numerical evaluation of an integral. 
The error resulting from nonzero T is called the aliasing error, which is discussed 
in more details in Chapter 5. Thus, we can express Eq. (3.84) as 

, No-l 

D„ = -7 -y f(kT)e~-' nn ° k (3.86a) 

N ° 

Now, from Eq. (3.85), fio-No = 27r. Hence, e Jndo(k+N 0 ) — e jnCi 0 k anc j f rom 
(3.86a), it follows that 

D n+No = D n (3.86b) 

Clearly, the Fourier spectrum D n repeats periodically with period No, which causes 
spectral overlap due to repeating cycles. To understand the nature of this overlap, 
see Fig. 5.12f. Generally, D n decays with n and the spectral overlap caused by the 
periodic repetition will have negligible effect if we use large enough No (the period). 
The first cycle intersects the second cycle at n — Nq/2. Hence, overlapping will be 
negligible if D n is very small for n > No/ 2. Because of the periodicity of D n , we need 
to evaluate only No values of D n over the range n = -Nq/2 to Nq/2 - 1. However, 
the DFT (or FFT) computes D n for n = 0 to 1V 0 — 1. The periodicity property 
D u +n 0 = D n means, beyond n = lVo/2, the coefficients represent the values for 
negative n. For instance, when Nq = 32, Dn = £>_ 15, D is = T>_ 14, ■■■,D 31 = 
D_i. The cycle repeats again from n = 32 on. 

We can use the efficient FFT (the fast Fourier transform discussed in Sec. 
5.3) to compute the right-hand side of the above equation. We shall use MATLAB 
to implement the FFT algorithm. For this purpose, we need samples of f(t) over 
one period starting at t = 0. In this algorithm, it is also preferable (although not 
necessary) that Nq be a power of 2, that is No = 2 m , where m is an integer. 


Q Computer Example C 3.1 

Compute and plot the trigonometric and exponential Fourier spectra for the periodic 
signal in Fig. 3.7b (Example 3.3). 


■ 
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The samples of /(f) start at t = 0 and the last (Ao-th) sample is at f = To - T (the 
last sample is not at t = To because the sample at t = 0 is identical to the sample at t = To, 
and the next cycle begins at t = To). At the points of discontinuity, the sample value is 
taken as the average of the values of the function on two sides of the discontinuity. Thus, 
in the present case, the first sample (at t = 0) is not 1, but (e -1 ^ 2 +■ l)/2 = 0.604. To 
determine No, we require that D n for n > No/2 to be negligible. Because /(f) has a jump 
discontinuity, D n decays rather slowly as 1/n. Hence, choice of No — 200 is acceptable 
because the (Ao/2)-nd (100th) harmonic is about 0.01 (about 1%) of the fundamental. 
However, we also require No to be power of 2. Hence, we shall take No = 256 = 2 s . 

We write and save a MATLAB file (or program) c31.m to compute and plot the 
exponential Fourier coefficients. 

% (c31.m) 

%M is the number of coefficients to be computed 
T0=pi;N0=256;T=T0/N0;M=10; 
t=0:T:T*(NO-l); t=t’; 
f=exp(-t/2);f(l)=0.604; 

% fft(f) is the FFT [the sum on the right-hand side of Eq. (3.86)] 
Dn=fft(f)/N0 

[Dnangle,Dnmag]=cart2pol(real(Dn),imag(Dn)); 
k=0:length(Dn)-l;k=k’; 
subplot (211), stem(k,Dnmag) 
subplot(212), stem(k,Dnangle) 

To compute trigonometric Fourier series coefficients, we recall the program c31.m 
along with commands to convert D n into C„ and 6 n . 

c31;clg 

C0=Dnmag(l); Cn=2*Dnmag(2:M); 

Amplitudes= [C0;Cn] 

Angles= D nangle ( 1 :M ) ; 

Angles=Angles*(180/pi); 
disp(’Amplitudes Angles’) 

[Amplitudes Angles] 

% To Plot the Fourier coefficients 
k=0:length( Amplitudes)-1; k=k’; 
subplot(211 ),stem(k, Amplitudes) 
subplot(212), stem(k, Angles) 

ans = 

Amplitudes Angles 
0 . 5043 0 

0.2446 -75.9622 

0.1251 -82.8719 

0.0837 -85.2317 

0.0629 -86.4175 

0.0503 -87.1299 

0.0419 -87.6048 

0.0359 -87.9437 

0.0314 -88.1977 

0.0279 -88.3949 Q 
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3.7 LTIC System Response to periodic Inputs 

A periodic signal can be expressed as a sum of everlasting exponentials (or 
sinusoids). We also know how to find the response of an LTIC system to an ever- 
lasting exponential. From this information we can readily determine the response 
of an LTIC system to periodic inputs. A periodic signal /(t) with period To can be 
expressed as an exponential Fourier series 

°° Oir 

/(*)= E D - e3 ™ ot "« = - 

n=— oo 

In Sec. 2.4-3, we showed that the response of an LTIC system with transfer func- 
tion H (s) to an everlasting exponential input e st is also an everlasting exponential 
H(s)e st . Therefore, the system response to everlasting exponential e^ ut is an ever- 
lasting exponential H (ju)e/ ut . This input-output pair can be displayed as} 

e jut H {ju)e iut 

input output 

Therefore, from linearity property 

OO OO 

E Dne^t =4. E D n H(jnu 0 )e jruJot (3.87) 

n=— oo 7T=— oc 

>» -* v v J 

input f(t) response y(t) 

The response y(t) is obtained in the form of an exponential Fourier series, and is 
therefore a periodic signal of the same period as that of the input. 

We shall demonstrate the utility of these results by the following example. 

I Example 3.9 

A full-wave rectifier (Fig. 3.20a) is used to obtain a dc signal from a sinusoid sin t. 
The rectified signal /(t), depicted in Fig. 3.18, is applied to the input of a a low-pass RC 
filter, which suppresses the time- varying component and yields a dc component with some 
residual ripple. Find the filter output y(t). Find also the dc output and the rms value of 
the ripple voltage. 

First, we shall find the Fourier series for the rectified signal /(t), whose period is 
To = ir. Consequently, wo = 2, and 

OO 

/(«)= e o ^ j2nt 

n=— oo 

where 

D n = - [ sin t e~ j2nt dt = (3.88) 

7T J a w(l - 4n 2 ) 

jThis result applies only to the asymptotically stable systems. This is because when s = ju, the 
integral on the right-hand side of Eq. (2.48) does not converge for unstable systems. Moreover, for 
marginally stable systems also, that integral does not converge in the ordinary sense, and H(juj) 
cannot be obtained by replacing s in H(s) with joj. 
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Fig. 3.20 A full-wave rectifier with a lowpass filter and its output. 



Note that the output y(t) is also a periodic signal given by the exponential Fourier series 
on the right-hand side. The output is numerically computed from the above equation and 
plotted in Fig. 3.20b. 
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The output Fourier series coefficient corresponding to n = 0 is the dc component 
of the output, given by 2/ir. The remaining terms in the Fourier series constitute the 
unwanted component called the ripple. We can determine the rms value of the ripple 
voltage by finding the power of the ripple component using Eq. (3.83). The power of 
the ripple is the power of all the components except the dc (n = 0). Note that D n , the 
exponential Fourier coefficient for the output y(t) is 

- _ 2 

n 7r(l — 4 n 2 )(j6n 4- 1) 

Therefore, from Eq. (3.83b), we have 


°° °° 2 2 s 00 ^ 

rtpple ?r(l — 4n 2 )(j6n + 1) n 2 (l — 4n 2 ) 2 (36n 2 + 1) 

n=l n—\ n = 1 

Numerical computation of the right-hand side yields 

FVipp!.; = 0.0025, and the ripple rms value = P T i Tv ic = 0.05 
This shows that the rms ripple voltage is 5% of the amplitude of the input sinusoid. I 


Why Use Exponentials? 

The exponential Fourier series is just another way of representing trigonomet- 
ric Fourier series (or vice versa). The two forms carry identical information — no 
more, no less. The reasons for preferring the exponential form have already been 
mentioned: This form is more compact, and the expression for deriving the expo- 
nential coefficients is also more compact, as compared to those in the trigonometric 
series. Furthermore, the system response to exponential signals is also simpler 
(more compact) than the system response to sinusoids. In addition, the mathemat- 
ical manipulation and handling of exponential form proves much easier than the 
trigonometric form in the area of signals as well as systems. For these reasons, in 
our future discussion we shall use the exponential form exclusively. 

A minor disadvantage of the exponential form is that it cannot be visualized 
as easily as sinusoids. For intuitive and qualitative understanding, the sinusoids 
have the edge over exponentials. Fortunately, this difficulty can be overcome read- 
ily because of close connection between exponential and Fourier spectra. For the 
purpose of mathematical analysis we shall continue to use exponential signals and 
spectra, but to understand the physical situation intuitively or qualitatively we shall 
speak in terms of sinusoids and trigonometric spectra. Thus, in future discussions, 
although all mathematical manipulation will be in terms of exponential spectra, we 
shall speak of exponential and sinusoids interchangeably when discussing intuitive 
and qualitative insights and the understanding of physical situations. This is an 
important point; readers should make an extra effort to familiarize themselves with 
the two forms of spectra, their relationships, and their convertibility. 


Dual Personality of a Signal 

The discussion so far shows that a periodic signal has a dual personality — the 
time domain and frequency domain. It can be described by its waveform or by its 
Fourier spectra. The time- and frequency-domain descriptions provide complemen- 
tary insights into a signal. For in-depth perspective, we need to understand both of 
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these identities. It is important for the reader to learn to think of a signal from both 
of these perspectives. In the next chapter, we shall see that aperiodic signals also 
have this dual personality. Moreover, we shall show that even LTI systems have this 
dual personality, which offers complementary insights into the system behavior. 

Limitations of the Fourier Series Method of Analysis 

We have developed here a method of representing a periodic signal as a weighted 
sum of everlasting exponentials whose frequencies lie along the jui- axis in the 5 - 
plane. This representation (Fourier series) is valuable in many applications. How- 
ever, as a tool for analyzing linear systems, it has serious limitations and conse- 
quently has limited utility for the following reasons: 

1. The Fourier series can be used only for periodic inputs. All practical inputs 
are aperiodic (remember that a periodic signal starts at 1 = -oo). 

2. This technique can be applied readily to asymptotically stable systems. It 
cannot handle so easily unstable or even marginally stable systems (see the 
footnote on p. 219). 

The first limitation can be overcome by representing aperiodic signals in terms 
of everlasting exponentials. This representation can be achieved through the Fourier 
integral, which may be considered as an extension of the Fourier series. We shall 
therefore use the Fourier series as a stepping stone to the Fourier integral developed 
in the next chapter. The second limitation can be overcome by using exponentials 
e st where 4 is not restricted to the imaginary axis, but is free to take on complex 
values. This generalization leads to the Laplace integral, discussed in Chapter 6 
(the Laplace transform). 


3.8 Appendix 


Appendix 3A: Derivation of Eq. (3.39) 

The error e(f) in the approximation (3.37) 


e(t) = /(*) - Y,c n xn(t) 


The error energy E e is 


r tz rt 2 ^ y 

E e = e 2 (t)dt = / /(f) - V'c rl x n ( 

Jti n=1 


(t) dt 


(3.91) 

(3.92) 


Since E e is a function of N parameters ci, C 2 , . . ., cjv, to minimize E e , a necessary 
condition is 


d 1 ^ 

= ~— / /( f)-Vc„i„(t) 

9c ■* Jti ti 


i= 1,2,. ..,1V 


When we expand the integrand, we find that all the cross-product terms arising 
from the orthogonal signals are zero by virtue of orthogonality; that is, all terms of 
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the form f x m (t)x n (t) dt with m £ n vanish. Similarly, the derivative with respect 
to Ci of all terms not containing c* is zero. For each i, this observation leaves only 
two nonzero terms in Eq. (3.93): 

[ [- 2 cif(t.)xi(t) + Ci 2 Xi 2 (t)] dt = 0 

cfc i Jti 
or 

rt 2 r <2 

—2 I f(t)xi(t) dt + 2ci I Xi 2 (t)dt~ 0 i=l,2, ...,n 

Jti Jti 


Therefore 


ft 2 

/ f(t)xi(t)dt , 

-Y Tt = ^ / 2 /(0*i(0 ^ i = 1, 2, .... N (3.94) 

I Xi 2 (t)dt lJtl 

Jti 


Derivation of Eq. (3.40) 


Ee= [ /(f) - y] C n x n{t) dt 

/«■ L n=l 

tt 2 N ^ ptl /*<2 

= / f 2 (t)dt + Y c n 2 / X n 2 {t)dt - 2 Yen / f(t)x n (t)dt 

/<> »=1 /‘I n=l /‘I 

Substitution of Eqs. (3.36) and (3.94) in this equation yields 

ft, N N 

E e — / / ( t ) dt 4- 'y c n E n — 2 y ^ c n E n 

/‘l n=l n = 1 

= / f 2 (t)dt-J2 c n 2 E n (3.95) 

n=l 

As N — > 00 for a complete orthogonal set, E e — ► 0, and the energy of f(t) is equal to 
the sum of energies of all the orthogonal components cixi(t), 02 x 2 ( 1 ), 03 x 3 ( 1 ), • • •• 

Appendix 3B: Orthogonality of the Trigonometric Signal Set 

Consider an integral I defined by 

/ = / cos nuiQt cos muiol dt (3.96a) 

Jt 0 

where J T stands for integration over any contiguous interval of To seconds. By 
using a trigonometric identity (see Sec. B.7-6), Eq. (3.96a) can be expressed as 

/ = - [ cos (n + m )iVQt dt + [ cos (n — m)u>ot dt (3.96b) 

2 UTo Jt 0 


■ 
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Since cos wo t executes one complete cycle during any interval of To duration, cos (n + 
m)u>Qt executes (n + m) complete cycles during any interval of duration To- There- 
fore, the first integral in Eq. (3.96b), which represents the area under (n + m) 
complete cycles of a sinusoid, equals zero. The same argument shows that the sec- 
ond integral in Eq. (3.96b) is also zero, except when n = m. Hence I in Eq. (3.96) 
is zero for all n ^ m. When n = m, the first integral in Eq. (3.96b) is still zero, but 
the second integral yields 


/ = !/ 

2 Jto 2 


cos nuigt cos mwot dt = 


Using similar arguments, we can show that 


0 n y m 

m=n /0 


(3.97a) 


sin moot sin iruoatdt — 


0 n 7 ^ m 

n = m 0 


(3.97b) 


/ sin nu)o t cos muiot dt = 0 for all n and m (3.97c) 

JTo 

Appendix 3C: Orthogonality of the Exponential Signal Set 

The set of exponentials e- ,nu '° t ( n = 0, ±1, ±2, . . .) is orthogonal over any inter- 
val of duration To, that is, 


[ e inl “ ot {e inwot y dt = [ e f( m -"Vo t dt = 

JTn JT 0 


Let the integral on the left-hand side of Eq. (3.98) be I. 


1= [ e jmu,ot (e jnu,ot y dt = [ 
JTn JTn 


O j{m-n)ujot 


The case m = n is trivial. In this case the integrand is unity, and I = Tq. When 
m 7 ^ n 


j ( m - n)u;o 




j(m - n)u>a 


e i(m-n)u„ti J e Rm-n)woTo _ _ Q 


The last result follows from the fact that uiqTo = 2ir, and e j2lrfc = 1 for all integral 
values of fc. 


3.9 Summary 


This chapter discusses the foundations of signal representation in terms of its 
components. There is a perfect analogy between vectors and signals; the analogy is 
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so strong that the term ‘analogy’ understates the reality. Signals are not just like 
vectors. Signals are vectors. The inner or scalar product of two (real) signals is the 
area under the product of the two signals. If this inner or scalar product is zero, 
the signals are said to be orthogonal. A signal f(t) has a component exit), where 
c is the inner product of /(f) and x{t) divided by E x , the energy of x(t). 

A good measure of similarity of two signals /(f) and x(t) is the correlation co- 
efficient e n , which is equal to the inner product of /(f) and x(t) divided by v /EjE x . 
It can be shown that — 1 < c n < 1. The maximum similarity (c n = 1) occurs only 
when the two signals have the same waveform within a (positive) multiplicative 
constant, that is, when /(f) = Kx(t). The maximum dissimilarity ( c n = -1) oc- 
curs only when /(f) = —Kx(t). Zero similarity ( c n = 0) occurs when the signals 
are orthogonal. In binary communication, where we are required to distinguish 
between the two known waveforms in the presence of noise and distortion, select- 
ing the two waveforms with maximum dissimilarity ( c n = -1) provides maximum 
distinguishabiiity. 

Just as a vector can be represented by the sum of its orthogonal components 
in a complete orthogonal vector space, a signal can also be represented by the 
sum of its orthogonal components in a complete orthogonal signal space. Such a 
representation is known as the generalized Fourier series representation. A vector 
can be represented by its orthogonal components in many different ways, depending 
on the coordinate system used. Similarly a signal can be represented in terms of 
different orthogonal signal sets of which the trigonometric and the exponential signal 
sets are two examples. We have shown that the trigonometric and exponential 
Fourier series are periodic with period equal to that of the fundamental in the 
set. In this chapter we have shown how a periodic signal can be represented as a 
sum of (everlasting) sinusoids or exponentials. If the frequency of a periodic signal 
is o>o, then it can be expressed as a sum of the sinusoid of frequency wo and its 
harmonics (trigonometric Fourier series). We can reconstruct the periodic signal 
from a knowledge of the amplitudes and phases of these sinusoidal components 
(amplitude and phase spectra). 

If a periodic signal has an even symmetry, the Fourier series contains only 
cosine terms. In contrast, if the signal has an odd symmetry, the Fourier series 
contains only sine terms. If a periodic signal has a jump discontinuity, the signal is 
not smooth and requires significant high frequency components to synthesize jumps. 
Consequently, its amplitude spectrum decays slowly with frequency as 1/n. If the 
signal has no jump discontinuities, but its first derivative has a jump discontinuity, 
the signal is smoother, and its amplitude spectrum decays faster as 1/n 2 . If neither 
the signal nor its first derivative has jump discontinuities, but the second derivative 
has discontinuities, then the signal is even more smooth, and its amplitude spectrum 
decays still faster as 1 /n 3 , and so on. 

A sinusoid can be expressed in terms of exponentials. Therefore, the Fourier se- 
ries of a periodic signal can also be expressed as a sum of exponentials (the exponen- 
tial Fourier series). The exponential form of the Fourier series and the expressions 
for the series coefficients are more compact than those of the trigonometric Fourier 
series. Also, the response of LTIC systems to an exponential input is simpler than 
that for a sinusoidal input. Moreover, the exponential form of representation lends 
itself better to mathematical manipulations than does the trigonometric form. For 
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these reasons, the exponential form of the series is preferred in modern practice in 
the areas of signals and systems. 

The plots of amplitudes and angles of various exponential components of the 
Fourier series as functions of the frequency are the exponential Fourier spectra 
(amplitude and angle spectra) of the signal. Because a sinusoid cos uot can be 
represented as a sum of two exponentials, e-*" 0 * and e~ J " ot , the frequencies in the 
exponential spectra range from — oo to oo. By definition, the frequency of a signal is 
always a positive quantity. Presence of a spectral component of a negative frequency 
— nwo merely indicates that the Fourier series contains terms of the form 
The spectra of the trigonometric and exponential Fourier series are closely related, 
and one can be found by the inspection of the other. 

The Fourier series coefficients C n or D n may be computed numerically using 
the discrete Fourier transform (DFT), which can be implemented by an efficient 
FFT (fast Fourier transform) algorithm. This method uses N 0 uniform samples of 
f(t) over one period starting at t = 0. 

In Sec. 3.7, we discuss a method of finding the response of an LTIC system to a 
periodic input signal. The periodic input is expressed as an exponential Fourier se- 
ries, which consists of everlasting exponentials of the form e jnwot . We also know that 
response of an LTIC system to an everlasting exponential e inuat is H (jnujo'jei™ 0 *. 
The system response is the sum of the system’s responses to all the exponential 
components in the Fourier series for the input. The response is, therefore, also an 
exponential Fourier series. Thus, the response is also a periodic signal of the same 
period as that of the input. 
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Problems 

3.1-1 Derive Equation (3.6) in an alternate way by observing that e = (f— cx) and 
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Fig. P3.1-2 


|e| 2 — (f— cx) • (f— cx)— |f| 2 +c 2 |x| 2 — 2cf-x. Hint: Find the value of c to minimize je | 2 . 

3.1- 2 (a) For the signals fit) and x(t) depicted in Fig. P3.1-2, find the component of 

the form x(t) contained in f(t). In other words find the optimum value of c in the 
approximation fit) -- cx(t) so that the error signal energy is minimum. 

(b) Find the error signal e(f) and its energy E c . Show that the error signal is 
orthogonal to x{t ), and that Ej = c 2 E x -t- E e . Can you explain this result in terms 
of vectors. 

3*1-3 For the signals fit) and x(f) shown in Fig. P3.1-2, find the component of the form f(t) 
contained in x(t). In other words, find the optimum value of c in the approximation 
x(t) « c/(t) so that the error signal energy is minimum. What is the error signal 
energy? 

3.1- 4 Repeat Prob. 3.1-2 if x(t) is a sinusoid pulse shown in Fig. P3.1-4. 



Fig. P3.1-4 


3.1-5 If x(t) and y(t) are orthogonal, then show that the energy of the signal x(t) + y(t) is 
identical to the energy of the signal x(t) - y(t) and is given by E x + E y . Explain this 
result using vector concepts. In general, show that for orthogonal signals x(t) and 
y(t) and for any pair of arbitrary constants ci and C 2 , the energies of cix(t) + C 2 y(t) 
and cjx(t) - C 2 y(t) are identical, given by c\E x + c\E y . 



fl 7 

/ 3 «) 


U / 



0 

1 !—*■ 



Fig. P3.2-1 
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3.2- 1 Find the correlation coefficient c„ of signal x(t ) and each of the four pulses /r(f), f 2 (t), 

/ 3 (f), and ji(t) depicted in Fig. P3.2-1. Which pair of pulses would you select for a 
binary communication in order to provide maximum margin against noise along the 
transmission path? 

3.3- 1 Let 11 (f) and x 2 (t) be two signals orthonormal (that is, with unit energies) over an 

interval from t = fi to t 2 . Consider a signal /(f) where 

f(t) = ClXl(t) + C2X 2 (t) t\<t<t 2 

This signal can be represented by a two-dimensional vector f(ci, c 2 ). 

(a) Determine the vector representation of the following six signals in the two- 
dimensional vector space: 

0) /i(f) = 2a;i(t) - x 2 (t) (iv) fi(t) = xi(t) + 212 (f) 

(ii) / 2 (f) = -£i(t) + 2x 2 (t) ( v ) / 5 (f) = 2xi(t) + x 2 (t) 

(iii) / 3 (f) = -x 2 (t) (vi) /«( f) = 3:ci (f) 

(b) Point out pairs of mutually orthogonal vectors among these six vectors. Verify 
that the pairs of signals corresponding to these orthogonal vectors are also orthogonal. 

3.4- 1 (a) Sketch the signal /(f) = f 2 for all f and find the trigonometric Fourier series <fi(t) 

to represent /(f) over the interval (-1, 1). Sketch ip(t) for all values of f. 

3.4- 2 (a) Sketch the signal /(f) = f for all t and find the trigonometric Fourier series ip(t) 

to represent /(f) over the interval (— rr, ir). Sketch <p(t) for all values of t. 

3.4- 3 For each of the periodic signals shown in Fig. P3.4-3, find the compact trigonometric 

Fourier series and sketch the amplitude and phase spectra. If either the sine or cosine 
terms are absent in the Fourier series, explain why. 

3.4- 4 (a) Find the trigonometric Fourier series for x(t) shown in Fig. P3.4-4. 

(b) The signal x(t) is the time-inverted signal <f(t) in Fig. 3.7b. Thus, x{t) = 

Hence, the Fourier series for x(t) can be obtained by replacing f with — t in the Fourier 
series [Eq. (3.56)] for ^j(f). Verify that the Fourier series thus obtained is identical to 
that found in part (a). 

(c) Show that, in general, time-inversion of a periodic signal does not affect the 
amplitude spectrum, and the phase spectrum is also unchanged except for the change 
of sign. 

3.4- 5 (a) Find the trigonometric Fourier series for the periodic signal x{t) depicted in Fig. 

P3.4-5. 

(b) The signal x(t) can be obtained by time-compressing the signal ip(t) in Fig. 3.7b 
by a factor 2. Thus, x(t) = ip(2t). Hence, the Fourier series for x(t) can be obtained 
by replacing t with 2t in the Fourier series [Eq. (3.56)] for Verify that the Fourier 
series thus obtained is identical to that found in part (a) . 

(c) Show that, in general, time-compression of a periodic signal by a factor a expands 
the Fourier spectra by the same factor a. In other words Co, C n , and 6 n remain un- 
changed, but the fundamental frequency is increased by the factor a, thus expanding 
the spectrum. Similarly time-expansion of a periodic signal by a factor a compresses 
its Fourier spectra by the factor a. 

3.4- 6 (a) Find the trigonometric Fourier series for the periodic signal g(t) in Fig. P3.4-6. 

Take advantage of the symmetry. 



-* ol n /2 k t — 2k 


Fig. P3.4-5 
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Fig. P3.4-6 


(b) Observe that g(t) is identical to f(t) in Fig. 3.9a left-shifted by 0.5 second. 
Therefore, g(t) = /(i + 0.5), and the Fourier series for $(i) can be found by replacing 
t with t + 0.5 in Eq. (3.63) [the Fourier series for /(t)j. Verify that the Fourier series 
thus obtained is identical to that found in part (a). 

(c) Show that, in general, a time shift of T seconds of a periodic signal does not 
affect the amplitude spectrum. However, the phase of the nth harmonic is decreased 
(increased) by ruooT for a delay (advance) of T seconds. 

3.4-7 If the two halves of one period of a periodic signal are of identical shape except that 
the one is the negative of the other, the periodic signal is said to have a half-wave 
symmetry. If a periodic signal f(t) with a period To satisfies the half-wave symmetry 
condition, then 

/ (* - f) = -/w 

In this case, show that all the even-numbered harmonics vanish, and that the odd- 
numbered harmonic coefficients are given by 

4 fTo/2 4 [To/2 

a n ~ ~ I /(t)cos nujQtdt and b n = — f(t)smnuotdt 

0 Jo 0 Jo 

Using these results, find the Fourier series for the periodic signals in Fig. P3.4-7. 



Fig. P3.4-8. 
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3.4- 8 Over a finite interval, a signal can be represented by more than one trigonometric 

(or exponential) Fourier series. For instance, if we wish to represent f(t) —t over an 
interval 0 < t < 1 by a Fourier series with fundamental frequency too = 2, we can 
draw a pulse f(t) = t over the interval 0 < t < 1 and repeat the pulse every tt seconds 
so that To = 7r and ujq — 2 (Fig. P3.4-8a). If we want the fundamental frequency ujq 
to be 4, we repeat the pulse every n/2 seconds. If we want the series to contain only 
cosine terms with uq = 2, we construct a pulse f(t) = \t\ over -1 < t < 1, and repeat 
it every n seconds (Fig. P3.4-8b). The resulting signal is an even function with period 
7T. Hence, its Fourier series will have only cosine terms with ujq = 2. The resulting 
Fourier series represents /(*) = t over 0 < t < 1 as desired. We do not care what it 
represents outside this interval. 

Represent f(t) = t over 0 < t < 1 by a Fourier series that has 

(a) ujq — § and contains all harmonics, but cosine terms only. 

(b) loo = 2 and contains all harmonics, but sine terms only. 

(c) ujq = ~ and contains all harmonics, which are neither exclusively sine nor cosine 

(d) uo = 1 and contains only odd harmonics and cosine terms. 

(e) uo — ^ and contains only odd harmonics and sine terms. 

(f) ujq — 1 and contains only odd harmonics, which are neither exclusively sine nor 
cosine. 

Hint: For parts d, e, and f, you need to use half wave symmetry discussed in Prob. 

3.4-7. Cosine terms imply possible dc component. 

3.4- 9 State, with reasons, whether the following signals are periodic or aperiodic. For 

periodic signals, find the period and state which of the harmonics are present in the 
series. 

(a) 3 sin t + 2 sin 3 1 (f ) sin ~ + 3 cos ^ + 3 sin (| + 30°) 

(b) 2 + 5 sin 4t + 4 cos It (g) sin 3 1 + cos ^ t 

(c) 2 sin 3 1 + 7 cos tt t (h) (3 s i n 2 1 + sin 5 1) 2 

(d) 7 cos irt + 5 sin 2wt (i) (5 sin 2 1) 3 

(e) 3 cos \/2t + 5 cos 2 1 



Fig. P3.4-10. 


3.4- 10 Find the trigonometric Fourier series for f(t) shown in Fig. P3.4-10 over the interval 

[0, 1], Use wo = 2w. Sketch the Fourier series ip(t) for all t. Compute the energy of 
the error signal e(t) if the number of terms in the Fourier series are N for N = 1, 2, 3 
and 4. 

Hint: Use Eq. (3.40) to compute error energy. 

3.4- 11 Walsh functions, which can take on only two amplitude values, form a complete set 

of orthonormal functions and are of great practical importance in digital applications 
because they can be easily generated by logic circuitry and because multiplication 
with these functions can be implemented by simply using a polarity reversing switch. 
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Figure P3.4-11 shows the first eight functions in this set. Represent f(t) in Fig. P3.4- 
11 over the interval [0, lj using a Walsh Fourier series using these 8 basis functions. 
Compute the energy of e(f), the error in the approximation using the first N non-zero 
terms in the series for N = 1, 2, 3 and 4. How does the Walsh series compare with 
the trigonometric series in Prob. 3.4-10 from the viewpoint of the error energy for a 
given N? 

3.4-12 A set of Legendre polynomials P„(t), (n = 0, 1, 2, 3, • • ■) forms a complete set of or- 
thogonal functions over the interval — 1 < t < 1. These polynomials are defined 

by 




n = 0,1,2,- 


Po{t) = 1 , Pi(t) = t 

ft(t) = ^(3t 2 -l), Ps(t)= |(5t 3 - 3t) etc. 


Thus 



Fig. P3.4-12. 

Legendre polynomials are orthogonal. Reader may verify that 

/ 1 ( oJLi m = n 

Pm(t)P n (t) dt — < 
i ^ 0 m n 


(a) Represent f(t) in Fig. P3.4-12a by the Legendre Fourier series over the interval 
— 1 < t < 1. Compute only first two nonzero coefficients of the series. Compute the 
energy of e(t), the error for the one and two (non-zero) term approximations. 

(b) Represent f(t) in Fig, P3.4-12b using the Legendre Fourier series. Compute the 
coefficients of the series for the first two non-zero terms. 

Hint: Although the series representation is valid only over — 1 < t < 1, it can be 
extended to any region by suitable time scaling. 

3.5- 1 For each of the periodic signals in Fig. P3.4-3, find the exponential Fourier series and 

sketch the corresponding spectra. 

3.5- 2 The trigonometric Fourier series of a certain periodic signal is given by 

f(t) — 3 + >/3cos 2t -1- sin 2 1 -f sin 3 t—\ cos (5£ -f 

(a) Sketch the trigonometric Fourier spectra. 

(b) By inspection of the spectra in part a, sketch the exponential Fourier series 
spectra. 

(c) By inspection of the spectra in part b, write the exponential Fourier series for 
/(*). 

Hint: To express the Fourier series in compact form, combine the sine and cosine 
terms of the same frequency. Moreover, all terms must appear in the cosine form 
with positive amplitudes. This can always be done by suitably adjusting the phase. 

3.5- 3 The exponential Fourier series of a certain periodic function is given as 

/(f) = (2+j2) e - j3t + j2e~ jt + 3 - j2e jt + (2 - /2)e J ' 3 ' 

(a) Sketch the exponential Fourier spectra. 

(b) By inspection of the spectra in part a, sketch the trigonometric Fourier spectra 
for /(f) . 

(c) Find the compact trigonometric Fourier series from these spectra. 

(d) Find the signal bandwidth. 

3.5- 4 If a periodic signal f{t) is expressed as an exponential Fourier series 

OO 

/(f) = y, D ^ ot 

n= — oo 

(a) Show that the exponential Fourier series for /(f) = f(t - T) is given by 

OO 

/(f) = y ^ eJn “ ot 


in which 


n= — oo 
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\Dn\ = |D„| and lD n = lD n - nuioT 

This result shows that time shifting of a periodic signal by T seconds 

merely changes the phase spectrum by nuoT. The amplitude spectrum is unchanged. 

(b) Show that the exponential Fourier series for f(t) = f(at) is given by 

OO 

f(t)= Dne jn{a “ o)t 


This result shows that time compression of a periodic signal by a factor a expands its 
Fourier spectra by the same factor a. Similarly, time expansion of a periodic signal 
by a factor a compresses its Fourier spectra by the factor a. 

3.5-5 (a) The Fourier series for the periodic signal in Fig. 3.10a is given in Exercise E3.6. 

Verify Parseval’s theorem for this series, given that 



n=l 


(b) If /(f) is approximated by the first N terms in this series, find N so that the 
power of the error signal is less than 1% of Pf. 

3.5-6 (a) The Fourier series for the periodic signal in Fig. 3.10b is given in Exercise E3.6. 

Verify Parseval’s theorem for this series, given that 


oo . 2 

E l _ ir 
n 2 8 


(b) If /(f) is approximated by the first N terms in this series, find N so that the 
power of the error signal is less than 10% of Pf. 

3.5- 7 The signal /(f) in Fig. 3.18 is approximated by the first 2iV + 1 terms (from n = —N 

to N ) in its exponential Fourier series given in Exercise E3.10. Determine the value 
of N if this (2 N + l)-term Fourier series power is to be no less than 99.75% of the 
power of /(t). 

3.6- 1 Find the response of an LTIC system with transfer function 


s 2 + 2s + 3 


to the periodic input shown in Fig. 3.7b. 



Continuous-Time Signal Analysis: 
The Fourier Transform 

In Chapter 3, we succeeded in representing periodic signals as a sum of (ever- 
lasting) sinusoids or exponentials. In this chapter we extend this spectral represen- 
tation to aperiodic signals. 

4.1 Aperiodic Signal Representation by Fourier Integral 

Applying a limiting process, we now show that an aperiodic signal can be 
expressed as a continuous sum (integral) of everlasting exponentials. To represent an 
aperiodic signal /(f) such as the one depicted in Fig. 4.1a by everlasting exponential 
signals, let us construct a new periodic signal /r 0 (f ) formed by repeating the signal 
/(f) at intervals of To seconds, as illustrated in Fig. 4.1b. The period To is made 
long enough to avoid overlap between the repeating pulses. The periodic signal 
/r 0 (f) can be represented by an exponential Fourier series. If we let To — * oo , the 
pulses in the periodic signal repeat after an infinite interval and, therefore 

lim f To (t) = /(f) 

1 0— »oo 

Thus, the Fourier series representing /r 0 (t) will also represent /(f) in the limit 
To — * oo. The exponential Fourier series for /r 0 (t) is given by 


OO 



fr 0 (t) 

= Y, D n ei™ at 

(4.1) 



71“ — OO 


where 

Dn= Ih. 

rTo/2 

/ /T 0 (<)c“ 3TUJot dt 

l-To/2 

(4.2a) 

and 


e 

o 

II 

SI? 

(4.2b) 
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Observe that integrating fr 0 (t) over (-^ L , ^-) is the same as integrating f(t) over 
(— 00 , 00 ). Therefore, Eq. (4.2a) can be expressed as 

(4 ' 2C) 


It is interesting to see how the nature of the spectrum changes as To increases. 
To understand this fascinating behavior, let us define F(w), a continuous function 
of w, as 



f(t)e- jut dt 


(4.3) 


A glance at Eqs. (4.2c) and (4.3) shows that 

D n = ^-F(nuo) 
To 


(4.4) 


This means that the Fourier coefficients D n are (1 /To) times the samples of F(w) 
uniformly spaced at intervals of wo, as depicted in Fig. 4.2a. f Therefore, (l/To)F(w) 
is the envelope for the coefficients D n . We now let To — > 00 by doubling To repeat- 
edly. Doubling To halves the fundamental frequency wo [Eq. (4.2b)], so that there 
are now twice as many components (samples) in the spectrum. However, by dou- 
bling To, the envelope (1/To) F(w) is halved, as shown in Fig. 4.2b. If we continue 
this process of doubling To repeatedly, the spectrum progressively becomes denser 
while its magnitude becomes smaller. Note, however, that the relative shape of 
the envelope remains the same [proportional to F(w) in Eq. (4.3)]. In the limit as 
To — * 00 , wo — * 0 and D n —> 0. This result means the spectrum is so dense that 
the spectral components are spaced at zero (infinitesimal) intervals. At the same 
time, the amplitude of each component is zero (infinitesimal). We have nothing of 
everything, yet we have something! This paradox sounds like Alice in Wonderland, 


(For the sake of simplicity, we assume Dn, and therefore F(w), in Fig. 4.2, to be real. The 
argument, however, is also valid for complex D n [or F(w)]. 
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Fig. 4.2 Change in the Fourier spectrum when the period To in Fig. 4.1 is doubled. 

but as we shall see, these are the classic characteristics of a very familiar phe- 
nomenon.) 

Substitution of Eq. (4.4) in Eq. (4.1) yields 

fr 0 (t)= £ (4.5) 

71— — 00 

As To — * 00 , wo becomes infinitesimal (wo — > 0). Hence, we shall replace wo by a 
more appropriate notation, Aw. In terms of this new notation, Eq. (4.2b) becomes 



To 


and Eq. (4.5) becomes 

fT„(t)= £ [ ^ — (4.6a) 

n =— 00 

Equation (4.6a) shows that /t o (0 can be expressed as a sum of everlasting expo- 
nentials of frequencies 0, ± Aw, ±2Aw, ±3Aw, .... (the Fourier series). The amount 
of the component of frequency nAw is [F(nAw)Aw]/27r. In the limit as To — > 
00 , Aw — > 0 and /t o (0 — * /(t). Therefore 

1 00 

}{t ) = lim /t o (0 = hm — V' f (nAw)e^" A “^A(j (4.6b) 

To — *00 Aid— *0 Z7T ' 

n= — 00 

The sum on the right-hand side of Eq. (4.6b) can be viewed as the area under the 
function F(w)e- 7u ' t , as illustrated in Fig. 4.3. Therefore 

1 f°° 

/« = j ~J_ F(w)e^ 4 dw (4.7) 

The integral on the right hand side is called the Fourier integral. We have now 
succeeded in representing an aperiodic signal f(t) by a Fourier integral (rather 


flf nothing else, the reader now has an irrefutable proof of the proposition that 0% ownership of 
everything is better than 100% ownership of nothing. 
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than a FourieT series). f This integral is basically a Fourier series (in the limit) 
with fundamental frequency A w — * 0, as seen from Eq. (4.6). The amount of the 
exponential nAut is F(n Aw)Aw/27t. Thus, the function F(w) given by Eq. (4.3) 
acts as a spectral function. 



Fig. 4.3 The Fourier series becomes the Fourier integral in the limit as To — * oo. 

We call F (w) the direct Fourier transform of / (f), and /(f) the inverse Fourier 
transform of F(w). The same information is conveyed by the statement that /(f) 
and F(w) are a Fourier transform pair. Symbolically, this statement is expressed as 

F(uj) = F[f(t)\ and /(f) = F~ l [F(w)] 


or 



/(f) 4=f- F(w) 


To recapitulate, 




F(w) = f f(t)e~* ut dt 

(4.8a) 


J — OO 


and 

i r°° 

f(t) = 2~ J PfaW*** 

(4.8b) 


It is helpful to keep in mind that the Fourier integral in Eq. (4.8b) is of the 
nature of a Fourier series with fundamental frequency Aw approaching zero [Eq. 
(4.6b)]. Therefore, most of the discussion and properties of Fourier series apply to 
the Fourier transform as well. We can plot the spectrum F(w) as a function of w. 
Since F( u) is complex, we have both amplitude and angle (or phase) spectra 

F( w) = |F(w)|e J ' ZF(w) (4.9) 

in which |F(iw)| is the amplitude and ZF(w) is the angle (or phase) of F(w). Ac- 
cording to Eq. (4.8a), 



From this equation and Eq. (4.8a), it follows that if /(f) is a real function of f, then 
F(w) and F(-w) are complex conjugates. Therefore 

fThis derivation should not be considered as a rigorous proof of Eq. (4.7). The situation is not as 
simple as we have made it appear. 1 
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|F(-w)| = |F(w)| (4.10a) 

ZF(-w) = -ZF(w) (4.10b) 

Thus, for real /(f), the amplitude spectrum |F(w)| is an even function, and the 
phase spectrum ZF(w) is an odd function of w. This property the (conjugate 
symmetry property) is valid only for real /(f). These results were derived earlier 
for the Fourier spectrum of a periodic signal [Eq. (3.77)] and should come as no 
surprise. The transform F(w) is the frequency-domain specification of /(t). 



Fig. 4.4 e at u (t) and its Fourier spectra. 



The amplitude spectrum |F(w)| and the phase spectrum ZF(w) are depicted in Fig. 4.4b. 
Observe that |F(w)| is an even function of w, and ZF(w) is an odd function of w, as 
expected. B 


Existence of the Fourier Transform 

In Example 4.1 we observed that when a < 0, the Fourier integral for e~ oi u(f) 
does not converge. Hence, the Fourier transform for e~ at u(t) does not exist if 
a < 0 (growing exponential). Clearly, not all signals are Fourier-transformable. The 
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existence of the Fourier transform is assured for any /(f) satisfying the Dirichlet 
conditions mentioned on p. 194-195. The first of these conditions is) 

/ OO 

\f{t)\dt < oo (413) 

■OO 

Because \e.~i ut \ = 1, from Eq. (4.8a), we obtain 

/ OO 

1 /( 01 * 

■oo 

This inequality shows that the existence of the Fourier transform is assured if condi- 
tion (4.13) is satisfied. Otherwise, there is no guarantee. We have seen in Example 
4.1 that the Fourier transform does not exist for an exponentially growing signal 
(which violates this condition). Although this condition is sufficient, it is not neces- 
sary for the existence of the Fourier transform of a signal. For example, the signal 
(sin at)/t violates condition (4.13), but does have a Fourier transform. Any signal 
that can be generated in practice satisfies the Dirichlet conditions and therefore has 
a Fourier transform. Thus, the physical existence of a signal is a sufficient condition 
for the existence of its transform. 

Linearity of the Fourier Transform 

The Fourier transform is linear; that is, if 

/i(t) <=> Fi(w) and / 2 (f) 4=> Fa(u>) 

then 

aifi(t) + 02 / 2 ( 4 ) -s=> oiFi(m) + o 2 F 2 (to) (4.14) 

The proof is trivial and follows directly from Eq. (4.8a). This result can be extended 
to any finite number of terms. 

4.1-1 Physical Appreciation of the Fourier Transform 

In understanding any aspect of the Fourier transform, we should remember that 
Fourier representation is a way of expressing a signal in terms of everlasting sinusoids 
(or exponentials). The Fourier spectrum of a signal indicates the relative amplitudes 
and phases of the sinusoids that are required to synthesize that signal. A periodic 
signal Fourier spectrum has finite amplitudes and exists at discrete frequencies 
(wo and its multiples). Such a spectrum is easy to visualize, but the spectrum of 
an aperiodic signal is not easy to visualize because it has a continuous spectrum. 
The continuous spectrum concept can be appreciated by considering an analogous, 
more tangible phenomenon. One familiar example of a continuous distribution is 
the loading of a beam. Consider a beam loaded with weights Di, I> 2 . D 3 , .... D n 
units at the uniformly spaced points 11 , 12 , . . . , x n , as shown in Fig. 4.5a. The total 
load Wt on the beam is given by the sum of these loads at each of the n points: 

fThe remaining Dirichlet conditions are as follows: in any finite interval, }(t) may have only a 
finite number of maxima and minima and a finite number of finite discontinuities. When these 
conditions are satisfied, the Fourier integral on the right-hand side of Eq. (4.8b) converges to f(t) 
at all points where f(t) is continuous and converges to the average of the right-hand and left-hand 
limits of /(t) at points where f(t) is discontinuous. 
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Fig. 4.5 Analogy for Fourier transform. 


n 

W T = J2 Di 

1 

Consider now the case of a continuously loaded beam, as depicted in Fig. 4.5b. In 
this case, although there appears to be a load at every point, the load at any one 
point is zero. This does not mean that there is no load on the beam. A meaningful 
measure of load in this situation is not the load at a point, but rather the loading 
density per unit length at that point. Let F( x) be the loading density per unit 
length of beam. It then follows that the load over a beam length Ax (Ax — > 0), at 
some point x, is F(x) Ax. To find the total load on the beam, we divide the beam 
into segments of interval Ax (Ax — > 0). The load over the nth such segment of 
length Ax is F(nAx)Ax. The total load Wj- is given by 

X n 

Wt = lim V"' F(nAx) Ax 



In the case of discrete loading (Fig. 4.5a), the load exists only at the n discrete 
points. At other points there is no load. On the other hand, in the continuously 
loaded case, the load exists at every point, but at any specific point x, the load 
is zero. The load over a small interval Ax, however, is [F(nAx)] Ax (Fig. 4.5b). 
Thus, even though the load at a point x is zero, the relative load at that point is 
F(x). 

An exactly analogous situation exists in the case of a signal spectrum. When 
/(<) is periodic, the spectrum is discrete, and /(f) can be expressed as a sum of 
discrete exponentials with finite amplitudes: 

/(f) = ^D n e^“‘ 

n 

For an aperiodic signal, the spectrum becomes continuous: that is, the spectrum 
exists for every value of w, but the amplitude of each component in the spectrum 
is zero. The meaningful measure here is not the amplitude of a component of some 
frequency but the spectral density per unit bandwidth. From Eq. (4.6b) it is clear 
that /(f) is synthesized by adding exponentials of the form e J ' nAaJt , in which the 
contribution by any one exponential component is zero. But the contribution by 
exponentials in an infinitesimal band Aw located at u = nAu is ^F(nAw)Aw, 
and the addition of all these components yields /(f) in the integral form: 
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i 00 1 coo 

/(f) = lira — Y F(nA u )e u " A " )t Au=- F{u>)e jut du (4.15) 

2?r n fr' 0O 2,r J-00 

The contribution by components within a band dui is ^F(u) dui = F(u. 1 ) dF, where 
dT is the bandwidth in hertz. Clearly, F(ui) is the spectral density per unit band- 
width (in hertz). It also follows that even if the amplitude of any one component is 
zero, the relative amount of a component of frequency u is F(u). Although F(ui) is 
a spectral density, in practice it is customarily called the spectrum of /(t) rather 
than the spectral density of /(<). Deferring to this convention, we shall call F(ui) 
the Fourier spectrum (or Fourier transform) of /(f). 



a t-~ b 

Fig. 4.6 Marvel of the Fourier transform. 


A Marvelous Balancing Act 

An important point to remember here is that /(t) is represented (or synthe- 
sized) by exponentials or sinusoids that are everlasting (not causal). Such conceptu- 
alization leads to a rather fascinating picture when we try to visualize the synthesis 
of a timelimited pulse signal /(f) (Fig. 4.6) by the sinusoidal components in its 
Fourier spectrum. The signal /(f) exists only over an interval (a, 6) and is zero 
outside this interval. The spectrum of /(f) contains an infinite number of exponen- 
tials (or sinusoids) which start at f = -00 and continue forever. The amplitudes 
and phases of these components are such that they add up exactly to /(f) over the 
finite interval (a, b) and add up to zero everywhere outside this interval. Juggling 
with amplitudes and phases of an infinite number of components to achieve such 
a perfect and delicate balance boggles the human imagination. Yet the Fourier 
transform accomplishes it routinely, without much thinking on our part. Indeed, 
we become so involved in mathematical manipulations that we fail to notice this 
marvel. 



The right-hand side is the Fourier transform of h(t), and according to our notation 
introduced in Eq. (4.3) this is H(u>), whereas the same entity is denoted by H (ju) 
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in the notation introduced in Chapter 2. Thus, to be consistent with the previous 
notation, we should have denoted the Fourier transform by F(jui) rather than F(u) 
in Eq. (4.3). In fact, the notation F(jui) for the Fourier transform is often used 
in the literature. It is, however, a bit clumsy and does not lend itself so easily 
to manipulation as the notation F(u). For this reason we shall continue with the 
dual notation, while remembering that both F(u>) and F(jui) represent the same 
entity. This fact is particularly important when we discuss the Laplace transform 
and filtering in the future, and should be kept in mind throughout the rest of the 
book. In the same way, we must remember that H(ui) and H(jui) represent the 
same entity. 

4.1-2 LTIC System Response Using the Fourier Transform 

We wanted to represent a signal /(f) as a sum of (everlasting) exponentials so 
that we could find a system response to /(f) as a sum of the system’s responses 
to the exponential components of /(f). Consider an asymptotically stable LTIC 
system with transfer function H(s). The response of this system to everlasting 
exponential e* ut is H{ui)e^ ut . Such an input-output pair will be denoted by the 
directed arrow representation as 



1 r°° 

= — / F(ui)H{u)e^ ut dui 
J — 00 

1 r°° 

= -j_n^d. 


where y(u/), the Fourier transform of y(t), is given byf 


(4.18) 


fThe relationship (4.19) applies only to the asymptotically stable systems. The reason is that 
when s = ju), the integral on the right-hand side of Eq. (2.48) does not converge for unstable 
systems. Moreover, even for marginally stable systems, that integral does not converges in the 
ordinary sense, and H(jto) [or H(u>)] cannot be obtained by replacing s in H(s) with jut. As shown 
in Eq. (4.44b), Eq. (4.19) can be applied to marginally stable systems provided H(u>) is interpreted 
as the Fourier transform of h(t) rather than as H(s) with s replaced by jut. 
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Y(u) = F(w)H(w) (4.19) 

In conclusion, we showed that for an LTIC system with transfer function H(s), if 
the input and the output are f(t) and y(t), respectively, and if 

f{t) 4=$- F(u>) y{t) 4=4- y(u) 

then for asymptotically stable systems 

y(ui) = F(u)H{u) 

We shall derive this result again later in a more formal way. 

The procedure of the frequency-domain method is identical to that of the time- 
domain method. In the time-domain case we express the input /(f) as a sum of 
its impulse components; in the frequency-domain case, the input is expressed as 
a sum of everlasting exponentials (or sinusoids). In the former case, the response 
y(t) obtained by summing the system’s responses to impulse components results 
in the convolution integral; in the latter case, the response obtained by summing 
the system’s response to everlasting exponential components results in the Fourier 
integral. These ideas can be expressed mathematically as follows: 

1 For the time-domain case 

S(t) =► hit) the impulse response of the system is h(t) 

/ oo 

f(x)S(t — x) dx expresses }(t) as a sum of impulse components 
-oo 

and 

/ oo 

f(x)h(t — X ) dx expresses y{t) as a sum of responses to impulse components 
-oo 

2 For the frequency-domain case 

e jutt the system response to e^ wt is 


1 /“ 


F( u>)e Jwt duj shows f(t) as a sum of everlasting exponential components 


i z -00 

y(t) = — / F{uj)H du y(t) is a sum of responses to exponential components 

7-co 


The frequency-domain view sees a system in terms of its frequency response 
(system response to various sinusoidal components). It views a signal as a sum of 
various sinusoidal components. Transmission of a signal through a (linear) system 
is viewed as transmission of various sinusoidal components of the signal through the 
system. 


I 



Fig. 4.7 A gate pulse. 


4.2 Transforms of Some Useful Functions 

For convenience, we now introduce a compact notation for some useful functions 
such as gate, triangle, and interpolation functions. 


Unit Gate Function 

We define a unit gate function rect (z) as a gate pulse of unit height and unit 
width, centered at the origin, as illustrated in Fig. 4.7a:f 


rect (z) = < 5 


The gate pulse in Fig. 4.7b is the unit gate pulse rect (z) expanded by a factor 
r and therefore can be expressed as rect(f) (see Sec. 1.3-2). Observe that r, the 
denominator of the argument of rect(f), indicates the width of the pulse. 

Unit Triangle Function 

We define a unit triangle function A(z) as a triangular pulse of unit height and 
unit width, centered at the origin, as shown in Fig. 4.8a 


A(z) = 


l-2|z| 


l^-l ^ 2 
|z| < | 


The pulse in Fig. 4.8b is A(^). Observe that here, as for the gate pulse, the 
denominator r of the argument of A(2) indicates the pulse width. 



f At x - 0, we require rect (i) = 0.5, because the inverse Fourier transform of a discontinuous 
signal converges to the mean of its two values at the discontinuity. 
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(a) 


(b) 


Fig. 4.9 A sine pulse. 

Interpolation Function sine (x) 

The function sin xjx is the “sine over argument” function denoted by sine (x).f 
This function plays an important role in signal processing. It is also known as the 
filtering or interpolating function. We define 

sinc(x) = ^ (4.22) 

X 

Inspection of Eq. (4.22) shows that 

1. sine (x) is an even function of x. 

2. sine (x) = 0 when sin x = 0 except at x = 0, where it appears indeterminate. 
This means that sine x = 0 for x = ±ir, ±2ir, ±37r , . . . 

3. Using L’Hopital’s rule, we find sinc(0) = 1 . 

4. sine (x) is the product of an oscillating signal sin x (of period 2ir) and a mono- 
tonically decreasing function l/x . Therefore, sine (x) exhibits sinusoidal os- 
cillations of period 27r, with amplitude decreasing continuously as l/x. 

Figure 4.9a shows sine (x). Observe that sine (x) — - 0 for values of x that are 
positive and negative integral multiples of 7r. Figure 4.9b shows sine (^jr). The 

fsinc (x) is also denoted by Sa (x) in the literature. Some authors define sine (x) as 

sin irx 
sine (x) = 

1TX 



m 
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Fig. 4.10 A gate pulse f(t), its Fourier spectrum F(uj), amplitude spectrum |F(w)|, and 
phase spectrum lF(u). 
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L /(0 = S(r) 

(a) , 

F (CD ) = 1 

(b) 





|i 

O 

0 CD-*- 


Fig. 4.11 Unit impulse and its Fourier spectrum. 


Bandwidth of rect(^) 

The spectrum F(w) in Fig. 4.10 peaks at w = 0 and decays at higher frequen- 
cies. Therefore, rect (£) is a lowpass signal with most of the signal energy in lower 
frequency components. Strictly speaking, because the spectrum extends from 0 to 
oo, the bandwidth is oo. However, much of the spectrum is concentrated within the 
first lobe (from w = 0 to w = y). Therefore, a rough estimate of the bandwidth of 
a rectangular pulse of width r seconds is rad/s, or \ Hz.f Note the reciprocal 
relationship of the pulse width with its bandwidth. We shall observe later that this 
result is true in general. 


B Example 4.3 

Find the Fourier transform of the unit impulse i(t). 

Using the sampling property of the impulse [Eq. (1.24)], we obtain 


or 



6(t)e~ iut dt = 1 


<5(t) 4=4> 1 


Figure 4.11 shows S(t) and its spectrum. H 


(4.24a) 

(4.24b) 


H Example 4.4 

Find the inverse Fourier transform of <5(w). 

On the basis of Eq. (4.8b) and the sampling property of the impulse function, 


Therefore 


^ -l [*(«)] 



6(u)e iut 



7- <=> 6(w) (4.25a) 

or 2n 

1 4=> 2v6(u) (4.25b) 

This result shows that the spectrum of a constant signal f(t) = 1 is an impulse 27n5(u>), as 
illustrated in Fig. 4.12. 

The result [Eq. (4.25b)] also could have been anticipated on qualitative grounds. 
Recall that the Fourier transform of /(f) is a spectral representation of /(f) in terms of 
everlasting exponential components of the form e^ ut . Now, to represent a constant signal 


fTo compute bandwidth, we must consider the spectrum only for positive values of u. See discus- 
sion on p. 212. 
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Fig. 4.12 A constant (dc) signal and its Fourier spectrum. 


f(t) - 1, we need a single everlasting exponential e iu,t with w = 0.{ This results in a 
spectrum at a single frequency w = 0. Another way of looking at the situation is that 
fit) 1 is a dc signal which has a single frequency w = 0 (dc). M 

If an impulse at in = 0 is a spectrum of a dc signal, what does an impulse at 
u) -u> 0 represent? We shall answer this question in the next example. 

■ Example 4.5 

Find the inverse Fourier transform of <5(w - w 0 ). 

Using the sampling property of the impulse function, we obtain 

i r°° 

F~ l [6(w - wo)] = — / 6(u>- w 0 )e 5W dw = -5-e?" 0 ' 

J — oo 

Therefore 

— e J " ot -t=t- 6 (w - wo) 
or 

e J "°‘ 27n5(w - w 0 ) (4.26a) 

This result shows that the spectrum of an everlasting exponential is a single impulse 
at w = w 0 . We reach the same conclusion by qualitative reasoning. To represent the 
everlasting exponential e : “°\ we need a single everlasting exponential e iut with w = w 0 . 
Therefore, the spectrum consists of a single component at frequency to = cj 0 . 

From Eq. (4.26a) it follows that 

e J ° <=> 27tS(uj + u>o) (4.26b) 

I Example 4.6 ^ 

Find the Fourier transforms of the everlasting sinusoid cos uj Q t. 

Recall the Euler formula 

cos w 0 1 = i(e-'“'°‘ + e“ Ja, °‘) 

{The constant multiplier 2w in the spectrum [F(w) = 2 tt6(w)] may be a bit puzzling. Since 
e \. Wlth a PP ears ‘hat Fourier transform of f(t) = 1 should be an impulse of 

strength unity rather than 2tr. Recall, however, that in the Fourier transform f(t) is synthesized 
not by exponentials of amplitude F(n Aw)Aw, but of amplitude 1/2 tt times F(n Aw)Aw, as seen 
trom Eq. 4.6b). Had we used variable F (hertz) instead of w, the spectrum would have been a 
unit impulse. 
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Fig. 4.13 A cosine signal and its Fourier spectrum. 


Adding Eqs. (4.26a) and (4.26b), and using the above formula, we obtain 

cos wot -5=4- v{f>{w + loo) + S(u - wo)] (4-27) 

The spectrum of cos wot consists of two impulses at wo and - wo, as shown in Fig. 4.13. 
The result also follows from qualitative reasoning. An everlasting sinusoid cos wo f can 
be synthesized by two everlasting exponentials, e j “ 0< and e - -’" 0 *. Therefore the Fourier 
spectrum consists of only two components of frequencies wo and — wo- B 

fl Example 4.7 

Find the Fourier transform of the unit step function u(t). 

Trying to find the Fourier transform of u(t) by direct integration leads to an indeter- 
minate result, because 



Observe that the upper limit of e * ut as t — * oo yields an indeterminate answer. So we 
approach this problem by considering u(t) as a decaying exponential e~ at u(t) in the limit 
as a — » 0 (Fig. 4.14a). Thus 

u (t) = lim e~ at u(t) 
a— *0 

and 

U (w) — lim J r {e~ at u(t)} = lim — i-r- (4.28a) 

a— *0 a— *0 a + JUt ' 

Expressing the right-hand side in terms of its real and imaginary parts yields 


U( U ) = lim f-j ^-5 I (4.28b) 

«->o Lr+w' a- i +w' i J 

1 



JV 

The function a/ (a 2 + uj 2 ) has interesting properties. First, the area under this function 
(Fig. 4.14b) is 7 r regardless of the value of a 


= lim ° - 

a — *0 .a/ 4- a 





Second, when a -> 0, this function approaches zero for all w £ 0, and all its area (?r) 
is concentrated at a single point w = 0. Clearly, as a -> 0, this function approaches an 
impulse of strength 7 r.f Thus 

U(ui) = tt 6 (w) + -1- (4.29) 

JW 

(The second term on the right-hand side of Eq. (4.28b), being an odd function of w, has zero area 
regardless of the value of a. As a — * 0, the second term approaches 1 /jut. 
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o t — ► To to — ► 


Fig. 4.14 Derivation of the Fourier transform of the step function. 

Note that u(t) is not a “true” dc signal because it is not constant over the interval — oo 
to oo. To synthesize a “true” dc, we require only one everlasting exponential with = 0 
(impulse at cj = 0). The signal u(t) has a jump discontinuity at t = 0. It is impossible 
to synthesize such a signal with a single everlasting exponential e? ut . To synthesize this 
signal from everlasting exponentials, we need, in addition to an impulse at lj = 0, all 
frequency components, as indicated by the term 1/ju) in Eq. (4.29). I 

A Exercise E4.2 

Show that the Fourier transform of the sign function sgn(t) depicted in Fig. 4.15a is 2/juj. 
Hint: Note that sgn(t) shifted vertically by 1 yields 2u(£) V- 

A Exercise E4.3 

Show that the inverse Fourier transform of F(u>) illustrated in Fig. 4.15b is /(t) = ^ sine (u>o£). 
Sketch /(£). V- 

A Exercise E4.4 

Show that cos(uo£ + 0) tt[5(cj + uo)e~i $ + 6(u — u>o)e J0 ]- 
Hint: cos (wot + 0) = y 



Fig. 4.15 


4.3 Some properties of the Fourier Transform 

We now study some of the important properties of the Fourier transform and 
their implications as well as applications. Before embarking on this study, we shall 
explain an important and pervasive aspect of the Fourier transform: the time- 
frequency duality. 
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Table 4.1 

A Short Table of Fourier Transforms 



/(<) 

F(v) 


1 

e _at i i(t) 

1 

a + ju 

a > 0 

2 

e at u(—t) 

i 

a - ju 

e 

V 

o 

3 

e-°l*t 

2a 

a 2 + w 2 

a > 0 

4 

te~ at u(t) 

1 

(a + ju) 2 

a > 0 

5 

t n e~ at u(t) 

n\ 

(a + jw) n+1 

a > 0 

6 

m 

1 


7 

i 

2x S(u) 


8 

e jw 0 i 

2x6(u - wo) 


9 

COS UJQt 

n[6(u> — wo) + <5(w + wo)] 


10 

sin toot 

jx[S(u + wo) - S( w - wo)] 


11 

u(t) 

+ JZ 


12 

sgnf 

_2_ 

JUI 


13 

COS UJot u(t) 

2 t^(w w 0 ) + <5(w + Wq)] + 


14 

sin too t «(<) 

2j[<5 (w w 0 ) S(u + w 0 )] + 


15 

e -at sin wo t u(f) 

WO 

(a-hjwF+ujg 

a > 0 

16 

e~ at cos uotu(t) 

a+iw 

(a+jw) 3 +wj‘ 

a > 0 

17 

rect (£) 

-rsinc (if) 


18 

sine (Wt) 

rect (jfo) 


19 


f sine 2 (*f) 


20 


^ (w) 


21 

OO 

J2 S{t — nT) 

n=—o o 

OO 

wo S(u — nwo) 

n=— oo 

II 

O 

3 

22 

e -t 2 /2<T 2 
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Fig. 4.16 A near symmetry between the direct and the inverse Fourier transforms. 

4.3-1 Symmetry of Direct and Inverse Transform Operations: 
Time-Frequency Duality 

Equations (4.8) show an interesting fact: the direct and the inverse transform 
operations are remarkably similar. These operations, required to go from }(t) to 
F(u) and then from F(w) to /(<), are depicted graphically in Fig. 4.16. There are 
only two minor differences in these operations: the factor 2 x appears only in the 
inverse operator, and the exponential indices in the two operations have opposite 
signs. Otherwise the two operations are symmetrical. f This observation has far- 
reaching consequences in the study of the Fourier transform. It is the basis of the 
so-called duality of time and frequency. The duality principle may be compared with 
a photograph and its negative. A photograph can be obtained from its negative, and 
by using an identical procedure, the negative can be obtained from the photograph. 
For any result or relationship between f(t ) and F(w), there exists a dual result or 
relationship, obtained by interchanging the roles of f(t) and F(w) in the original 
result (along with some minor modifications arising because of the factor 2i and 
a sign change). For example, the time-shifting property, to be proved later, states 
that if f(t) <=> F(w), then 

f(t - t 0 ) <=> F{u>)e-i“ t0 (4.30a) 

The dual of this property (the frequency-shifting property) states that 

fOf the two differences, the former can be eliminated by change of variable from u to T (in hertz). 
In this case 

u) = 27 \T and du> = 2tt dT 

Therefore, the direct and the inverse transforms are given by 

/ oo poo 

f{t)e- j2,r:Ft dt and f{t) = / 

-oo J — oo 

This leaves only one significant difference, that of sign change in the exponential index. Otherwise 
the two operations are symmetrical. 
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F(u> — o>o) 


(4.30b) 


Observe the role reversal of time and frequency in these two equations (with the 
minor difference of the sign change in the exponential index). The value of this 
principle lies in the fact that whenever we derive any result, we can be sure that 
it has a dual. This possibility can give valuable insights about many unsuspected 
properties or results in signal processing. 

The properties of the Fourier transform are useful not only in deriving the direct 
and inverse transforms of many functions, but also in obtaining several valuable 
results in signal processing. The reader should not fail to observe the ever-present 
duality in this discussion. We begin with the symmetry property, which is one of 
the consequences of the duality principle discussed. 

4.3-2 Symmetry Property 


This property states that if 


m «=* F(w) 


F(t) 2irf(—u!) 
Proof: According to Eq. (4.8b) 


f [i) = h j^Fix^d: 

2nf(-t)= r F(x)e~ jxt c 

J — oo 


Changing t to ui yields Eq. (4.31). 

I Example 4.8 

In this example we apply the symmetry property [Eq. (4.31)] to the pair in Fig. 4.17a. 
From Eq. (4.23) we have 


Also, F(t) is the same as F(u) with u> replaced by t, and /(-w) is the same as f(t) with 
t replaced by — u>. Therefore, the symmetry property (4.31) yields 


sine (5) 


= 27r rect 


In Eq. (4.33) we used the fact that rect (-x) = rect (x) because rect is an even function. 
Figure 4.17b shows this pair graphically. Observe the interchange of the roles of t and u) 
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(b) I 

Fig. 4.17 Symmetry property of the Fourier transform. 


(with the minor adjustment of the factor 2tr). This result appears as pair 18 in Table 4 1 
(with r/2 = W). 

As an interesting exercise, the reader should generate the dual of every pair in Table 
4.1 by applying the symmetry property. U 

A Exercise E4.5 

Apply symmetry property to pairs 1, 3, and 9 (Table 4.1) to show that 

(a) jiTz <=* 2 tt e“ w u(-w) (b) «=* 27re"«M 

(c) 6(t + to) + 6(t — to) <=> 2 cos tow y 

4.3-3 The Scaling Property 

If 

}{t) <=>■ F(u) 

then, for any real constant o, 

/(at) *=> If 0 (4.34) 

Proof: For a positive real constant a, 

•F[/(<*0] = / /(at)e- Ju;t df = - f f(x)e^ :iu ^ x dx=-F(-) 

J -oo a J -oo a \ a / 

Similarly, we can demonstrate that if a < 0, 

f(at) 4=^ — -F 

a \ a / 


Hence follows Eq. (4.34). 
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Fig. 4.18 Scaling property of the Fourier transform. 


Significance of the Scaling Property 

The function f(at) represents the function f(t) compressed in time by a factor 
a (see Sec. 1 .3-2). Similarly, a function F(%) represents the function F( a) expanded 
in frequency by the same factor a. The scaling property states that time compression 
of a signal results in its spectral expansion, and time expansion of the signal results 
in its spectral compression. Intuitively, compression in time by a factor a means 
that the signal is varying rapidly by the same factor. To synthesize such a signal, 
the frequencies of its sinusoidal components must be increased by the factor a, 
implying that its frequency spectrum is expanded by the factor a. Similarly, a 
signal expanded in time varies more slowly; hence the frequencies of its components 
are lowered, implying that its frequency spectrum is compressed. For instance, the 
signal cos 2w 0 t is the same as the signal cos u>o t time-compressed by a factor of 2. 
Clearly, the spectrum of the former (impulse at ±2u 0 ) is an expanded version of the 
spectrum of the latter (impulse at ±uo). The effect of this scaling is demonstrated 
in Fig. 4.18. 


Reciprocity of Signal Duration and Its Bandwidth 

The scaling property implies that if f(t) is wider, its spectrum is narrower, 
and vice versa. Doubling the signal duration halves its bandwidth and vice versa. 
This suggests that the bandwidth of a signal is inversely proportional to the signal 
duration or width (in seconds). We have already verified this fact for the gate pulse, 
where we found that the bandwidth of a gate pulse of width r seconds is £ Hz. More 
discussion of this interesting topic appears in the literature. 2 

By letting a = -1 in Eq. (4.34), we obtain the time and frequency inversion 
property 


f(-t) 4=* F(-ui) 


(4.35) 
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Example 4.9 


Find the Fourier transforms of e at u(—t) and e a,t| . 

Application of Eq. (4.35) to pair 1 (Table 4.1) yields 



e at u{— t) -<=>• — 

a- ju> 


Also 

e -«l*i — e ” ot u (£) 4. e ai u(—t) 


Therefore 

6 1 1 , • + — 2,2 
a+juj a — ju) a* + oj* 

(4.36) 

The signal e 11,1 and its spectrum are illustrated in Fig. 4.19. B 


1 

V / ft ).,-' 1 ' 1 jfl 

: V a +0) 

_____ ^ 


(b) 

o ! 

o 

(0 


Fig. 4.19 e~ a and its Fourier spectrum. 


4.3-4 The Time-Shifting Property 


If 



then 

/(«) 4=> FM 



f(t-to) 4=4* F(w)e-* ut ° 

(4.37a) 


Proof: By definition, 

/ oo 

/(< - to) 

•OO 

Letting t — to = x, we have 


e~i ut dt 


/ OO 

/(z)e-^( I+t °> dx 

•OO 

= e~j“ to [ f(x)e~ jux dx = F(u)e- 

J — OO 


(4.37b) 


This result shows that delaying a signal by to seconds does not change its amplitude 
spectrum. The phase spectrum, however, is changed by -wto- 

Physical Explanation of the Linear Phase 

Time delay in a signal causes a linear phase shift in its spectrum. This result 
can also be derived by heuristic reasoning. Imagine f(t) being synthesized by its 
Fourier components, which are sinusoids of certain amplitudes and phases. The 
delayed signal /(f — to) can be synthesized by the same sinusoidal components, 



258 


4 Continuous-Time Signal Analysis: The Fourier Transform 



Fig. 4.20 Physical explanation of the time-shifting property. 

each delayed by t 0 seconds. The amplitudes of the components remain unchanged. 
Therefore, the amplitude spectrum of f(t - to) is identical to that of / (t). The time 
delay of to in each sinusoid, however, does change the phase of each component. 
Now, a sinusoid cos u it delayed by to is given by 

cos w(t — to) = cos (wt - utg) 

Therefore a time delay t 0 in a sinusoid of frequency w manifests as a phase delay 
of wt 0 . This is a linear function of w, meaning that higher- frequency components 
must undergo proportionately higher phase shifts to achieve the same time delay. 
This effect is depicted in Fig. 4.20 with two sinusoids, the frequency of the lower 
sinusoid being twice that of the upper. The same time delay to amounts to a phase 
shift of tr/2 in the upper sinusoid and a phase shift of ir in the lower sinusoid. This 
verifies the fact that to achieve the same time delay, higher-frequency sinusoids must 
undergo proportionately higher phase shifts. The principle of linear phase shift is 
very important and we shall encounter it again in distortionless signal transmission 
and filtering applications. 


H Example 4.10 

Find the Fourier transform of e _ “l t_t ol. 

This function, shown in Fig. 4.21a, is a time-shifted version of e a (depicted in Fig. 
4.19a). From Eqs. (4.36) and (4.37) we have 


g-o|t-tol 


2a — ju.<o 

a 2 + u i 2 


(4.38) 


The spectrum of e _ “ |t_<oi (Fig. 4.21b) is the same as that of e a|t| (Fig. 4.19b), except 
for an added phase shift of -iota ■ 

Observe that the time delay to causes a linear phase spectrum -wt 0 . This example 
clearly demonstrates the effect of time shift. H 
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F(o>.i = -(or 0 


Fig. 4.21 Effect of time-shifting on the Fourier spectrum of a signal. 

I Example 4.11 

Find the Fourier transform of the gate pulse f(t) illustrated in Fig. 4.22a. 

The pulse f(t) is the gate pulse rect (±) in Fig. 4.10a delayed by t/ 2 seconds. Hence, 
according to Eq. (4.37a), its Fourier transform is the Fourier transform of rect (-) multi- 
plied by . Therefore 

F(w) = r sine 

The amplitude spectrum |F(w)| (depicted in Fig. 4.22b) of this pulse is the same as that 
indicated in Fig. 4.10c. But the phase spectrum has an added linear term — wr/2. Hence, 
the phase spectrum of f(t) is identical to that in Fig. 4.10b plus a linear term -wr /2, as 
indicated in Fig. 4.22c. ■ 

A Exercise E4.6 

Using pair 18 and the time-shifting property, show that the Fourier transform of 
sinc[wo(t - T)] is ^rect(~)e~t uT . Sketch the amplitude and phase spectra of the Fourier 
transform. V 



Fig. 4.22 Another example of time-shifting and its effect on the Fourier spectrum of a 
signal. 


4.3-5 The Frequency-Shifting Property 

If 


f{t) F(w) 


then 


/(t)e 2 “°‘ 


F(u> - wq) 


( 4 . 39 ) 




Fig. 4.24 An example of spectral shifting by amplitude modulation. 


and demodulation appears in Secs. 4.7 and 4.8. 

To sketch a signal /(f) cos wot, we observe that 


/(f) cos wgt = 


{ 


/(*) 

-/(<) 


when cos wot = 1 
when cos wot = - 1 


Therefore, /(f) cos wo t touches f(t) when the sinusoid cos wot is at its positive peaks 
and touches -/(t) when cos wot is at its negative peaks. This means that /(f) and 
-/(f) act as envelopes for the signal f(t) cos w 0 t (see Fig. 4.23). The signal -/(t) 
is a mirror image of /(f) about the horizontal axis. Figure 4.23 shows the signal 
/(f), /(f) cos w 0 t and their spectra. 


■ Example 4.12 

Find and sketch the Fourier transform of the modulated signal /(f) cos lOt in which 
/(f) is agate pulse rect(|) as illustrated in Figure 4.24a. 

From pair 17 (Table 4.1) we find rect ( | ) <=> 4 sinc(2w), which is depicted in Fig. 
4.24b. From Eq. (4.41) it follows that 

/(f) cos lOf i[F(w + 10) + F(w - 10)] 

In this case, F(w) = 4 sinc(2w). Therefore 

/(f) cos lOf -^=4- 2 sine [2(w + 10)] + 2 sine [2(w - 10)] 

The spectrum of /(f) cos lOf is obtained by shifting F(w) in Fig. 4.24b to the left by 
10 and also to the right by 10, and then multiplying it by one-half, as depicted in Fig. 
4.24d. ■ 

A Exercise E4.7 

Sketch signal e - l‘l cos lOf. Find the Fourier transform of this signal and sketch its spectrum. 
Answer: F(w) = (u ,_ 1 ’ )2+1 + ( w+1 o) 3 +1 ■ The spectrum is that in Fig. 4.19b (with a = 1), shifted 
to ±10 and multiplied by one-half. y 


Application to Modulation 

Modulation is used to shift signal spectra. Some of the situations where spec- 
trum shifting is necessary are presented next. 
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1. If several signals, each occupying the same frequency band, are transmitted 
simultaneously over the same transmission medium, they will all interfere; it 
will be impossible to separate or retrieve them at a receiver. For example, if 
all radio stations decide to broadcast audio signals simultaneously, the receiver 
will not be able to separate them. This problem is solved by using modulation, 
whereby each radio station is assigned a distinct carrier frequency. Each sta- 
tion transmits a modulated signal. This procedure shifts the signal spectrum 
to its allocated band, which is not occupied by any other station. A radio 
receiver can pick up any station by tuning to the band of the desired station. 
The receiver must now demodulate the received signal (undo the effect of mod- 
ulation). Demodulation therefore consists of another spectral shift required to 
restore the signal to its original band. Note that both modulation and demod- 
ulation implement spectral shifting; consequently, demodulation operation is 
similar to modulation (see Sec. 4.7). 

This method of transmitting several signals simultaneously over a channel by 
sharing its frequency band is known as frequency-division multiplexing 
(FDM). 

2. For effective radiation of power over a radio link, the antenna size must be of the 
order of the wavelength of the signal to be radiated. Audio signal frequencies 
are so low (wavelengths are so large) that impracticably large antennas will be 
required for radiation. Here, shifting the spectrum to a higher frequency (a 
smaller wavelength) by modulation solves the problem. 

4.3-6 Convolution 

The time convolution property and its dual, the frequency convolution property, 

state that if 


/i(0 <=* -FiM 


and 


F 2 (ui) 
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then (time convolution) 

/i(t) * /2M <=*■ Fi(w)F 2 (w) 

and (frequency convolution) 


<=> 2^Fi(w) * F 2 (<j) 


Proof: By definition 

/ oo r poo 

e~i ut / /i(t)/ 2 (< - r)d,T dt 

•00 L J —00 

/ oo r rOO 

fl(r) / e~ iut f 2 (t - r)dt dr 

-oo \.J— 00 

The inner integral is the Fourier transform of / 2 (t — t), given by [time-shifting 
property in Eq. (4.37)] ,F 2 (u))e _J " T . Hence 

/ OO pOO 

fi(T)e~ jLJT F 2 (u)dT = F 2 (ui) / fi(T)e~ julT dT = Fi (w)F 2 (u>) 

-00 J — 00 

We have demonstrated in Eq. (2.48) that the transfer function H(u>) is the 
Fourier transform of the unit impulse response h{t). Thus 


hit) <=* H(u>) 


(4.44a) 


Application of the time convolution property to y(t) = f{t) * h{t) yields (assuming 
both f(t) and h{t ) are Fourier transformable) 


Y(ui) = F(u)H{ at) 


(4.44b) 


This is precisely the result proved earlier in Eq. (4.19).f 

The frequency convolution property (4.43) can be proved in exactly the same 
way by reversing the roles of }(t) and F{ui). 

■ Example 4.13 

Using the time convolution property, show that if 

fit) <=► F(w) 

then 

/ /(r)dr •*=*• — + 7rF(0)<5(w) (4.45) 

J - oo 


it follows that 


u(t - r) = | 1 

(0 r : 


/(f )*“(*)= / }{T)u{t — t ) dr = / f{r) dr 


fin Eq. (4.44b), h(t) 4=t- To understand finer points of Eq. (4.44b), see footnote on p. 243. 
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Now, from the time convolution property [Eq. 4.42], it follows that 


f 


/(r) dr ■t=>F(us) - — h 


■ + itF(0)6(lj) 


In deriving the last result, we used Eq. (1.23a) M 
A Exercise E4.8 

Using the time convolution property, show that f(t) * 6(t) = f(t) V 
A Exercise E4.9 

Using the time convolution property, show that 


e~ at u{t) * e~ b ‘u(t) = — \e~ at - e- bt ] u{t) 
b — a *■ J 


Hint: Use property (4.42) to find the Fourier transform of e at u(t ) * e bt u(t). Then use partial 
fraction expansion to find its inverse Fourier transform. V 

4.3-7 Time Differentiation and Time Integration 


then (time differentiation)! 


/(<) •<=> f(») 


df , , 

— <=*• juF(u>) 
at 


and (time integration) 


f f(r)dr <=> — - — - + 7tF(0)i5(w) 
J-oo 2“ 


Proof: Differentiation of both sides of Eq. (4.8b) yields 


^ = — f°° jwF(u)e jut du> 
dt 2tt ’ 


This result shows that 


df , , 

— juF{u) 
dt 


(Valid only if the transform of df/dt exists. 
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Table 4.2 

Fourier Transform Operations 


Operation 

/(*) 

F(u>) 

Addition 

fl{t) + / 2 (f) 

Fi(uj) + F 2 (us ) 

Scalar multiplication 

kf(t) 

kF(cj) 

Symmetry 

F(t) 

2? rf(—u) 

Scaling (a real) 

}{at) 

|a[ \a ) 

Time shift 

f{t ~ to) 

F(u)e-i“ to 

Frequency shift (wo real) 

/(t)e^ Wot 

0 

3 

1 

Time convolution 

/i(t)*/ 2 (t) 

Fi(u)F 2 (u>) 

Frequency convolution 

/i(<)/ 2 (<) 

-^Fl(w) * F 2 (ui) 

Time differentiation 

d n f 

dt n 

(ju>) n F{u) 

Time integration 

/ }{x)dx 

J — OO 

^- + ttF(0)6(u) 
JU 


Repeated application of this property yields 

~ *=► [ju) n F{u) (4.48) 

The time-integration property [Eq. (4.47)] has already been proved in Example 


I Example 4.14 

Using the time-differentiation property, find the Fourier transform of the triangle 
pulse A(^) illustrated in Fig. 4.25a. 

To find the Fourier transform of this pulse we differentiate the pulse successively, 
as illustrated in Fig. 4.25b and c. Because df/dt is constant everywhere, its derivative, 
d 2 f/dt 2 , is zero everywhere. But df/dt has jump discontinuities with a positive jump of 
2/r at t = ±J, and a negative jump of 4/r at t = 0. Recall that the derivative of a 
signal at a jump discontinuity is an impulse at that point of strength equal to the amount 
of jump. Hence, d 2 f/dt 2 , the derivative of df/dt, consists of a sequence of impulses, as 
depicted in Fig. 4.25c; that is, 

§ = ;[*(*+ §) -2«(t) +«((-§)] 



(4.49) 
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Fig. 4.25 Finding the Fourier transform of a piecewise-linear signal using the time- 
differentiation property. 


From the time-differentiation property (4.48) 

<=> (ju) 2 F(u>) = -w 2 F(w) (4.50a) 

dt 2 

Also, from the time-shifting property (4.37) 

6(t - t 0 ) •*=> e~ j “ t0 (4.50b) 

Taking the Fourier transform of Eq. (4.49) and using the results in Eqs. (4.50), we obtain 

-u < 2 F» = f W** ~ 2 + e-^] = ± (cos - l) = -f sin 2 (*f) 


8 2 r r sin (^) 1 2 r . 2 

FM = _|_ sin 2 ( T ) = 2 =2 smc It) 


The spectrum F(u) is depicted in Fig. 4.25d. This procedure of finding the Fourier trans- 
form can be applied to any function f(t) made up of straight-line segments with f(t) 0 
as |t| -> 00 . The second derivative of such a signal yields a sequence of impulses whose 
Fourier transform can be found by inspection. This example suggests a numerical method 
of finding the Fourier transform of an arbitrary signal f(t) by approximating the signal by 
straight-line segments. B 


A Exercise E4.10 

Find the Fourier transform of rect (•£), using the time-differentiation property. V 
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4.4 Signal Transmission through LTIC Systems 

If /(f) and y(t) are the input and output of an LTIC system with transfer 
function H( to), then, as demonstrated in Eq. (4.44b) 

Y(l>) = H(u)F(w) (4.52) 

This result applies only to asymptotically (and marginally) stable systems because 
of the reasons discussed in the footnote of p. 243. Moreover, /(f) has to be Fourier 
transformable. Consequently, exponentially growing inputs cannot be handled by 
this method. 

In Chapter 6, we shall see that the Laplace transform, which is a generalized 
Fourier transform, is more versatile and capable of analyzing all kinds of LTIC 
systems whether stable, unstable, or marginally stable. Laplace transform can also 
handle exponentially growing inputs. Compared to the Laplace transform, the 
Fourier transform in system analysis is clumsier. Hence, the Laplace transform 
is preferable to the Fourier transform in LTIC system analysis, and we shall not 
belabor the application of the Fourier transform to LTIC system analysis. We 
consider just one example here. 

B Example 4.15 

Find the zero-state response of a stable LTIC system with transfer function) 

= 7T2 ( 453 > 

and the input /(t) = e _t u(f). In this case, 

F(w) = jZT+i and = = 

Therefore 



A Exercise E4.ll 

For the system in Example 4.15, show that the zero-input response to the input £) is 

v(t) = 5 [e‘u(-t) + e _2t u(t)J. 

Hint: Use pair 2 (Table 4.1) to find the Fourier transform of £). y 
■{■Stability implies that the region of convergence of H(s) includes the ju> axis. 
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4.4-1 Signal Distortion during Transmission 

For a system with transfer function H M, if F(w) and F(u>) are the spectra of 
the input and the output signals, respectively, then 

Y(u>) = F(u)H{u) (4.55) 

The transmission of the input signal f(t) through the system changes it into the 
output signal y(t). Equation (4.55) shows the nature of this change or modification. 
Here F(u>) and Y(v) are the spectra of the input and the output, respectively. 
Therefore, H(u) is the spectral response of the system. The output spectrum is 
obtained by the input spectrum multiplied by the spectral response of the system. 
Equation (4.55), which clearly brings out the spectral shaping (or modification) of 
the signal by the system, can be expressed in polar form as 

|y (w) | e ^M = 

Therefore 

|y(w)| = |F(u))||f/H| ( 4 - 56a ) 

£Y(u) = lF(w) + £H{u>) (4.56b) 

During transmission, the input signal amplitude spectrum |F(w)| is changed to 
|F(w)| \H M|. Similarly, the input signal phase spectrum ZF(w) is changed to 
ZF(oi) 4- /.H (ui). An input signal spectral component of frequency u is modified in 
amplitude by a factor \H{u)\ and is shifted in phase by an angle LH{u). Clearly, 
|H(u))| is the amplitude response, and LH( u>) is the phase response of the sys- 
tem. The plots of M| and LH{u) as functions of u show at a glance how the 
system modifies the amplitudes and phases of various sinusoidal inputs. For this 
reason, H(u) is called the frequency response of the system. During transmis- 
sion through the system, some frequency components may be boosted in amplitude, 
while others may be attenuated. The relative phases of the various components also 
change. In general, the output waveform will be different from the input waveform. 

Distortionless Transmission 

In several applications, such as signal amplification or message signal trans- 
mission over a communication channel, we require that the output waveform be a 
replica of the input waveform. In such cases we need to minimize the distortion 
caused by the amplifier or the communication channel. It is, therefore, of practical 
interest to determine the characteristics of a system that allows a signal to pass 
without distortion (distortionless transmission). 

Transmission is said to be distortionless if the input and the output have iden- 
tical waveshapes within a multiplicative constant. A delayed output that retains 
the input waveform is also considered distortionless. Thus, in distortionless trans- 
mission, the input f(t) and the output ylt) satisfy the condition 


y(t) = kf(t - t d ) 


(4.57) 
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Fig. 4.26 LTIC system Frequency response for distortionless transmission. 
The Fourier transform of this equation yields 


But 

Therefore 


y(ui) = kF{w)e- ju,u 

Y(u) = F(u/)H(u) 
H(y>) = ke~ jutd 


This is the transfer function required for distortionless transmission. From this 
equation it follows that 

M| = k (4.58a) 


ZJ7 (ui) = —utd 


(4.58b) 


This result shows that for distortionless transmission, the amplitude response \H Ml 
must be a constant, and the phase response ZH(w) must be a linear function of u> 
with slope -td, where t d is the delay of the output with respect to input (Fig. 4.26). 


Intuitive Explanation of the Distortionless Transmission Conditions 

It is instructive to derive the conditions for distortionless transmission heuris- 
tically. Once again, imagine f(t) to be composed of various sinusoids (its spectral 
components), which are being passed through a distortionless system. For the dis- 
tortionless case, the output signal is the input signal multiplied by k and delayed 
by t d - To synthesize such a signal, we need exactly the same components as those 
of /(t), with each component multiplied by k and delayed by t d - Thus, the sys- 
tem transfer function H(u) should be such that each sinusoidal component suffers 
the same attenuation k and each component undergoes the same time delay of t d 
seconds. The first condition requires that 


|ffMI = fc 

We have seen in our discussion on p. 258 that to achieve the same time delay t d for 
every frequency component requires a linear phase delay ut d (Fig. 4.20). Therefore 

LH (ui) = —ut d 

This equation shows that the time delay resulting from signal transmission through 
a system is the negative of the slope of the system phase response LH{ui)\ that is, 

<dM = M 


(4.59) 
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If the slope of IH (u>) is constant (that is, if LH (w) is linear with to), all the compo- 
nents are delayed by the same time interval td- But if the slope is not constant, the 
time delay td varies with frequency. This variation means that different frequency 
components undergo different amounts of time delay, and consequently the output 
waveform will not be a replica of the input waveform. A good way to judge phase 
linearity is to plot td as a function of frequency. For a distortionless system, td 
should be constant over the band of interest. 

It is often thought (erroneously) that flatness of amplitude response \H(u>)\ 
alone can guarantee signal quality. However, a system may have a flat amplitude 
response and yet distort a signal beyond recognition if the phase response is not 
linear (td not constant). 

The Nature of Distortion in Audio and Video Signals 

Generally speaking, a human ear can readily perceive amplitude distortion, 
although it is relatively insensitive to phase distortion. For the phase distortion to 
become noticeable, the variation in delay [variation in the slope of lH(u>)] should 
be comparable to the signal duration (or the physically perceptible duration, in 
case the signal itself is long). In the case of audio signals, each spoken syllable can 
be considered as an individual signal. The average duration of a spoken syllable is 
of a magnitude of the order of 0.01 to 0.1. seconds. The audio systems may have 
nonlinear phases, yet no noticeable signal distortion results because in practical 
audio systems, maximum variation in the slope of IH(uj) is only a small fraction 
of a millisecond. This is the real truth underlying the statement that “the human 
ear is relatively insensitive to phase distortion.” 3 As a result, the manufacturers of 
audio equipment make available only |H(w)|, the amplitude response characteristic 
of their systems. 

For video signals, in contrast, the situation is exactly the opposite. The human 
eye is sensitive to phase distortion but is relatively insensitive to amplitude dis- 
tortion. The amplitude distortion in television signals manifests itself as a partial 
destruction of the relative half-tone values of the resulting picture, which is not 
readily apparent to the human eye. The phase distortion (nonlinear phase), on the 
other hand, causes different time delays in different picture elements. The result is 
a smeared picture, which is readily perceived by the human eye. Phase distortion is 
also very important in digital communication systems because the nonlinear phase 
characteristic of a channel causes pulse dispersion (spreading out), which in turn 
causes pulses to interfere with neighboring pulses. This interference can cause an 
error in the pulse amplitude at the receiver: a binary 1 may read as 0, and vice 
versa. 

4.5 Ideal and practical filters 

Ideal filters allow distortionless transmission of a certain band of frequencies 
and suppress all the remaining frequencies. The ideal lowpass filter (Fig. 4.27), for 
example, allows all components below u = W rad/s to pass without distortion and 
suppresses all components above w = W . Figure 4.28 illustrates ideal highpass and 
bandpass filter characteristics. 

The ideal lowpass filter in Fig. 4.27a has a linear phase of slope -td, which 
results in a time delay of td seconds for all its input components of frequencies 
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(a) (b) 

Fig. 4.27 Ideal lowpass filter: its frequency response and impulse response. 


below W rad/s. Therefore, if the input is a signal f(t) bandlimited to W rad/s, the 
output y(t) is f(t) delayed by td ; that is, 

v(t) = f(t - t d ) 

The signal f(t) is transmitted by this system without distortion, but with time 
delay td- For this filter |if(w)| = rect(^) and LH(ui) = e~i utd , so that 

H(ui) = rect e~ jutd (4.60a) 

The unit impulse response h(t) of this filter is obtained from pair 18 (Table 4.1) 
and the time-shifting property 

h(t)=r ~ 1 H (^) 

W 

= — sine [W (i — i d )] (4.60b) 

7T 

Recall that h(t) is the system response to impulse input 6(t), which is applied at 
t = 0. Figure 4.27b shows a curious fact: the response h(t) begins even before the 
input is applied (at t = 0). Clearly, the filter is noncausal and therefore physically 
unrealizable. Similarly, one can show that other ideal filters (such as the ideal 
highpass or the ideal bandpass filters depicted in Fig. 4.28) are also physically 
unrealizable. 

For a physically realizable system, h(t ) must be causal; that is, 
h(t) = 0 for t < 0 

In the frequency domain, this condition is equivalent to the well-known Paley- 
Wiener criterion, which states that the necessary and sufficient condition for the 
amplitude response |/f(<u)| to be realizable is 



[NgMll 

1 + w 2 


dui < 00 


(4.61) 


If H(u>) does not satisfy this condition, it is unrealizable. Note that if |ff(w)| = 0 
over any finite band, | ln|/f (w)|| = 00 over that band, and the condition (4.61) is vi- 
olated, If, however, H (w) = 0 at a single frequency (or a set of discrete frequencies), 
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Fig. 4.28 Ideal highpass and bandpass filter frequency response. 


h(t) 


A 

0 

r\/ 

9 V/ — 


Fig. 4.29 Approximate realization of an ideal lowpass filter by truncation of its impulse 
response. 

the integral in Eq. (4.61) may still be finite even though the integrand is infinite. 
Therefore, for a physically realizable system, H(u>) may be zero at some discrete 
frequencies, but it cannot be zero over any finite band. According to this criterion, 
ideal filter characteristics (Figs. 4.27 and 4.28) are clearly unrealizable^ 

The impulse response h(t ) in Fig. 4.27 is not realizable. One practical approach 
to filter design is to cut off the tail of k(t) for t < 0. The resulting causal impulse 
response h(t), where 

h(t) = h(t)u(t) 

is physically realizable because it is causal (Fig. 4.29). If t d is sufficiently large, h(t) 
will be a close approximation of h(t), and the resulting filter H{u) will be a good 
approximation of an ideal filter. This close realization of the ideal filter is achieved 
because of the increased value of time-delay t d . This observation means that the 
price of close realization is higher delay in the output; this situation is common in 
noncausal systems. Of course, theoretically, a delay t d = oo is needed to realize the 
ideal characteristics. But a glance at Fig. 4.27b shows that a delay t d of three or four 
times pp will make h(t) a reasonably close version of /i(t-t<j). For instance, an audio 


t|i7(w)| is assumed to be square-integrable, that is, 



|tf(w)| 2 4w 


is finite. Note that the Paley- Wiener criterion is a criterion for the realizability of the amplitude 
response |/f(u*)|. 
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filter is required to handle frequencies of up to 20 kHz ( W = 40, OOOtt). In this case, 
a t d of about 10~ 4 (0.1 ms) would be a reasonable choice. The truncation operation 
(cutting the tail of h{t) to make it causal), however, creates some unsuspected 
problems. We discuss these problems and their cure in Sec. 4.9. 

In practice, we can realize a variety of filter characteristics to approach ideal 
characteristics. Practical (realizable) filter characteristics are gradual, without jump 
discontinuities in amplitude response. We shall study such filter families (Butter- 
worth and Chebyshev) in Secs. 7.4 and 7.5. Figure 7.17 illustrates the amplitude 
response of lowpass Butterworth filters. 

A Exercise E4.12 

Show that a filter with Gaussian transfer function H(lj) = e~ QW is unrealizable. Demon- 
strate this fact in two ways: first by showing that its impulse response is noncausal, and then by 
showing that |tf(w)| violates the Paley-Wiener criterion. 

Hint: Use pair 22 in Table 4.1 V 

Thinking in Time- and Frequency-Domains: A Two Dimensional View of 
Signals and Systems 

Both signals and systems have dual personalities; the time domain and the fre- 
quency domain. For a deeper perspective, we should examine and understand both 
these identities because they offer complementary insights. An exponential signal, 
for instance, can be specified by its time domain description such as e~ 2t u(t) or by 
its Fourier transform (its frequency domain description) The time-domain 

description depicts the waveform of a signal. The frequency-domain description por- 
trays its spectral composition (relative amplitudes of its sinusoidal (or exponential) 
components and their phases). For the signal e~ 2t , for instance, the time-domain 
description portrays the exponentially decaying signal with a time constant 0.5. 
The frequency-domain description characterizes it as a lowpass signal, which can 
be synthesized by sinusoids with amplitudes decaying with frequency roughly as 
\/u>. 

An LTIC system can also be described or specified in the time domain by its 
impulse response h{t) or in the frequency domain by its transfer function H(u>). In 
Sec. 2.7, we studied intuitive insights in the system behavior offered by the impulse 
response, which consists of characteristic modes of the system. By purely qualitative 
reasoning, we saw that the system responds well to signals that are similar to the 
characteristic modes and responds poorly to signals which are very different from 
those modes. We also saw that the shape of the impulse response h(t) determines 
the system time constant (speed of response), and pulse dispersion (spreading), 
which, in turn, determines the rate of pulse transmission. 

The transfer function H (ui) specifies the frequency response; that is, the system 
response to exponential or sinusoidal input of various frequencies. This is precisely 
the filtering characteristic of the system. 

Experienced electrical engineers instinctively think in both domains (the time 
and frequency) whenever possible. When they look at a signal, they consider, its 
waveform, the signal width (duration), and the rate at which the waveform de- 
cays. This is basically a time-domain perspective. They also think of the signal 
in terms of its frequency spectrum-that is, in terms of its sinusoidal components 
and their relative amplitudes and phases. This is the frequency-domain perspective. 
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When they think of a system, they think of its impulse response h(t). The width 
of h(t) indicates the time constant (response time); that is, how fast the system 
is capable of responding to an input, and how much dispersion (spreading) it will 
cause. This is the time-domain perspective. From the frequency-domain perspec- 
tive, these engineers view a system as a filter, which selectively transmits certain 
frequency components and suppresses the others [frequency response H(u)]. Know- 
ing the input signal spectrum and the frequency response of the system, they create 
a mental image of the output signal spectrum. This concept is precisely expressed 
by Y(u) = F(u>)ff{u). 

We can analyze LTI systems by time-domain techniques or by frequency- 
domain techniques. Then why learn both? The reason is that the two domains 
offer complementary insights into system behavior. Some aspects are easily grasped 
in one domain; other aspects may be easier to see in the other domain. Both the 
time-domain and the frequency-domain methods are as essential for the study of 
signals and systems as two eyes are essential to a human being for correct visual 
perception of reality. A person can see with either eye, but for proper perception 
of three dimensional-reality, both eyes are essential. 

It is important to keep the two domains separate, and not to mix the entities 
in the two domains. If we are using the frequency domain to determine the system 
response, we must deal with all signals in terms of their spectra (Fourier transforms) 
and all systems in. terms of their transfer functions. For example, to determine the 
system response y(t) to an input /(f), we must first convert the input signal into 
its frequency domain description F(u). The system description also must be in the 
frequency-domain; that is, the transfer function H{u>). The output signal spectrum 
Y(w) = F(oj)H(u>). Thus, the result (output) is also in the frequency domain. To 
determine the final answer y(t), we must take the inverse transform of Y(u>). 


4.6 Signal Energy 

The signal energy E; of a signal f(t) was defined in Chapter 1 as 

E f = r \f(t)\ 2 dt (4.62) 

J — OO 

Signal energy can be related to the signal spectrum F(u) by substituting Eq. (4.8b) 
in the above equation: 

/ oo poo 1 poo 

mr(t)dt = J J(t) - J dt 

Here we used the fact that /*(f), being the conjugate of /(t), can be expressed as 
the conjugate of the right-hand side of Eq. (4.8b). Now, interchanging the order of 
integration yields 
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Fig. 4.30 Interpretation of Energy spectral density of a signal. 


Consequently, 

/ oo -1 poo 

\f(t)\ 2 dt = —J |F(w)| 2 d w 


(4.64) 


This is the statement of the well-known Parseval’s theorem (for Fourier trans- 
form). A similar result was obtained in Eqs. (3.42)and (3.82) for a periodic signal 
and its Fourier series. This result allows us to determine the signal energy from ei- 
ther the time-domain specification /(f) or the frequency-domain specification F(ui) 
of the same signal. 

Equation (4.63) can be interpreted to mean that the energy of a signal /(f) 
results from energies contributed by all the spectral components of the signal /(f). 
The total signal energy is the area under \F(u>) 2 \ (divided by 27r). If we consider a 
small band A ui (Au> -+ 0), as illustrated in Fig. 4.30, the energy A Ef of the spectral 
components in this band is the area of |F(w)| 2 under this band (divided by 2 tt): 

AE f = ~\F( u )\ 2 A u = \F(u,)\ 2 AF —■ = AF Hz (4.65) 

Therefore, the energy contributed by the components in this band of AF (in hertz) 
is |F(w)| 2 AF. The total signal energy is the sum of energies of all such bands and 
is indicated by the area under |F(w)| 2 as in Eq. (4.63). Therefore, |F(w)| 2 is the 
energy spectral density (per unit bandwidth in hertz). 

For real signals, F(w) and F(—ui) are conjugates, and |F(w)| 2 is an even func- 
tion of w because 

|F(w)| 2 = F(w)F*(w) = F(w)F(-w) 


Therefore, Eq. (4.63) can be expressed asf 

1 

Ef = — |F(w)| 2 dw 

T Jo 


(4.66) 


The signal energy Ef, which results from contributions from all the frequency com- 
ponents from w = 0 to oo, is given by (l/7r times) the area under |F(w)| 2 from u> — 0 
to oo. It follows that the energy contributed by spectral components of frequencies 
between aq and oq is 

1 FU>2 

A E f = - \F(ui)\ 2 daj (4.67) 

ft Ju>i 


fin Eq. (4.66) it is assumed that F(uj) does not contain an impulse at uj — 0. If such an impulse 
exists, it should be integrated separately with a multiplying factor of 1 / 27 T rather than 1 /tt. 
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■ Example 4.16 

Find the energy of signal /(t) = e~ at u(t). Determine the frequency W (rad/s) so 
that the energy contributed by the spectral components of all the frequencies below IV is 
95% of the signal energy E /. 

We have „ „„ 

poo poo 4 

E f = j fm=J o e ~ 2a ‘ dt =^ 

We can verify this result by Parseval’s theorem. For this signal 


an 1 /*°° 1 f°° 1 1 u ) !°° 1 

E f = — \F(ui)\ 2 dw=- - 5 — — — tan -1 — = — 

’ k J 0 v ' -k J 0 u> 2 + a 2 Tta a lo 2 a 

The band ui = 0 to u> = W contains 95% of the signal energy, that is, 0.95/2a. 
Therefore, from Eq. (4.67) with oji — 0 and 0*2 = W, we obtain 


0.95 _ 1_ r 

2 “ ~ * Jo 


1 . -1 u 

■ = — tan — 


| W 1 _! W 

= — tan — 


= tan -1 — = 4 > W = 12.706 a rad/s 
2 a 

This result indicates that the spectral components of /(f) in the band from 0 (dc) to 
12.706a rad/s (2.02a Hz) contribute 95% of the total signal energy; all the remaining 
spectral components (in the band from 12.706a rad/s to 00 ) contribute only 5% of the 
signal energy. H 
A Exercise E4.13 

Use Parseval’s theorem to show that the energy of the signal 

/«= 12^-2 


i — . Hint: Find F{u) using pair 3 and the symmetry property. V 


The Essential Bandwidth of a Signal 

Spectra of most of the signals extend to infinity. However, because the energy 
of any practical signal is finite, the signal spectrum must approach 0 as ui -4 00 . 
Most of the signal energy is contained within a certain band of B Hz, and the 
energy contributed by the components beyond B Hz is negligible. We can therefore 
suppress the signal spectrum beyond B Hz with little effect on the signal shape and 
energy. The bandwidth B is called the essential bandwidth of the signal. The 
criterion for selecting B depends on the error tolerance in a particular application. 
We may, for example, select B to be that band which contains 95% of the signal 
energy! This figure may be higher or lower than 95%, depending on the precision 
needed. Using such a criterion, we can determine the essential bandwidth of a signal. 
The essential bandwidth B for the signal e~ at u(t), using 95% energy criterion, was 
determined in Example 4.16 to be 2.02a Hz. 

"For lowpass signals, the essential bandwidth may also be defined as a frequency at which the 
value of the amplitude spectrum is a small fraction (about 1%) of its peak value. In Example 4.16, 
for instance, the peak value, which occurs at u = 0, is 1/a. 
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Suppression of all the spectral components of /(f) beyond the essential band- 
width results in a signal f(t), which is a close approximation of /(f). If we use the 
95% criterion for the essential bandwidth, the energy of the error (the difference) 
/(f) - /(f) is 5% of Ef. 

Energy Spectral Density From Autocorrelation Function 

Correlation of a function /(f) with itself is its autocorrelation function 
ffy(f), which, for a real /(f), is given by [see Eq. (3.32)] 

/ OO 

}(x)f(x — t)dx (4.68a) 

■OO 

Also, from Eq. (3.31) with g(t) = /(f), it follows that 

V>/(f) = /(f) * f(-t) (4.68b) 

From Eq. (4.68b) it is clear that 

V>/(-f) = f(~t) * f(t) = il> f{l) 

Therefore, for real /(f), autocorrelation function ipf(t) is an even function of t. The 
Fourier transform of Eq. (4.68b) yields 

V’z(t) <=4- |F(ui )| 2 (4.69) 

Therefore, the Fourier transform of the autocorrelation function is its energy spec- 
tral density |F(u;)| 2 . It is clear that rpf(t) provides the spectral information of /(f) 
directly. 

The direct link of the autocorrelation function to the spectral information can 
be explained intuitively as follows. The autocorrelation function ipj{t) is the corre- 
lation of a signal with itself delayed by f seconds. A signal /(f) correlates perfectly 
with itself with zero delay. But as the delay increases, the similarity decreases. 
Thus, the autocorrelation function tf(t) is a nonincreasing function of f. If /(f) 
is a slowly varying signal (low frequency signal), it changes slowly with f. Conse- 
quently such a signal will show considerable similarity or correlation with itself even 
for relatively large delay. The autocorrelation function V>/(f) decays slowly with f 
and has a larger width. On the other hand, for a rapidly varying signal, the signal 
similarity will decrease rapidly with delay f and ^/(O has a smaller width. Thus, 
the shape of ^/(f) has a direct link to spectral information of /(f). 

4.7 Application to Communications: Amplitude Modulation 

Modulation causes a spectral shift in a signal and is used to gain certain ad- 
vantages mentioned in Sec. 4.3-5. Broadly speaking, there are two classes of modu- 
lation: amplitude (linear) modulation and angle (nonlinear) modulation, which are 
the subject of the next two sections. In this section, we shall discuss some practical 
forms of amplitude modulation. 

4.7-1 Double Sideband, Suppressed Carrier (DSB-SC) Modulation 

In amplitude modulation, the amplitude A of the carrier Acos(ca c f + $ c ) is 
varied in some manner with the baseband (message)t signal m(f) (known as the 

(The term baseband is used to designate the band of frequencies of the signal delivered by the 
source or the input transducer. 
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Fig. 4.31 DSB-SC modulation. 

modulating signal). The frequency uj c and the phase 8 C are constant. We can as- 
sume 8 C = 0 without a loss of generality. If the carrier amplitude A is made directly 
proportional to the modulating signal m(f), the modulated signal is m(t) cos w c f 
(Fig. 4.31a). As was indicated earlier [Eq. (4.41)], this type of modulation simply 
shifts the spectrum of m(t) to the carrier frequency (Fig. 4.31c). Thus, if 

m(t) <*=$> M (w) 


m(f ) cos c o c t 


- [M (ui + u c ) + M (u - u c )\ 


Recall that M(u> — ui c ) is M{w) shifted to the right by ui c and M(ui + u c ) is M (uj) 
shifted to the left by ui c . Thus, the process of modulation shifts the spectrum of the 
modulating signal to the left and the right by w c . Note also that if the bandwidth 
of m(t) is B Hz, then, as indicated in Fig. 4.31c, the bandwidth of the modulated 
signal is 2 B Hz. We also observe that the modulated signal spectrum centered 
at u > c is composed of two parts: a portion that lies above ui c , known as the upper 
sideband (USB), and a portion that lies below w c , known as the lower sideband 
(LSB). Similarly, the spectrum centered at -ui c has upper and lower sidebands. 
This form of modulation is called double sideband (DSB) modulation for obvious 


reason. 
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The relationship of B to u> c is of interest. Figure 4.31c shows that u> c > 2irB in 
order to avoid the overlap of the spectra centered at ±w c . If u c < 2nB , the spectra 
overlap and the information of m(t) is lost in the process of modulation, a loss which 
makes it impossible to get back m(t) from the modulated signal m(t) cos w c f.f 

I Example 4.17 

For a baseband signal m(t) = cos iu m t, find the DSB signal, and sketch its spectrum. 
Identify the upper and lower sidebands. 

We shall work this problem in the frequency-domain as well as the time-domain 
in order to clarify the basic concepts of DSB-SC modulation. In the frequency-domain 
approach, we work with the signal spectra. The spectrum of the baseband signal m(t) = 
cos u i m t is given by 

M(u) = tt[S(u - u m ) + 8(it) + w m )] 

The spectrum consists of two impulses located at ±u > m , as depicted in Fig. 4.32a. The 
DSB-SC (modulated) spectrum, as indicated by Eq. (4.70), is the baseband spectrum in 
Fig. 4.32a shifted to the right and the left by io c (times one-half), as depicted in Fig. 4.32b. 
This spectrum consists of impulses at i(u; c — c o m ) and rbfwc -i- tu m ). The spectrum beyond 
ui c is the upper sideband (USB), and the one below ui c is the lower sideband (LSB). Observe 
that the DSB-SC spectrum does not have the component of the carrier frequency ui c . This 
is why it is called double sideband-suppressed carrier (DSB-SC) . 


M(( 0 ) 



Fig. 4.32 An example of DSB-SC modulation. 


In the time-domain approach, we work directly with signals in the time-domain. For 
the baseband signal m(t) = cos w m t, the DSB-SC signal v^dsb-scW is 

Vdsb-scW = m W cos 

= COS u) m t COS <jJ c t 

i[cos (o>c + UJnx)t + COS (cj c - w m )i] (4.71) 

fPractical factors may impose additional restrictions on ui c . For instance, in broadcast appli- 
cations, a radiating antenna can radiate only a narrowband without distortion. This restriction 
implies that to avoid distortion caused by the radiating antenna, u c /2nB » 1. The broadcast 
band AM radio, for instance, with B = 5 kHz and the band of 550 to 1600 kHz for carrier frequency 
give a ratio of uJc/2nB roughly in the range of 100 to 300. 
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This result shows that when the baseband (message) signal is a single sinusoid of frequency 
w m , the modulated signal consists of two sinusoids: the component of frequency ui c + u m 
(the upper sideband), and the component of frequency ui c — w m (the lower sideband). Figure 
4.32b illustrates precisely the spectrum of V’dsb-scM- Thus, each component of frequency 
u m in the modulating signal results into two components of frequencies ui c + ui m and 
- ui m in the modulated signal. This being a DSB-SC (suppressed carrier) modulation, 
there is no component of the carrier frequency ui c on the right-hand side of the above 
equation as expected.) H 



cos(o c i 

(Carrier) 


(b) Specirum of e(r) 



Fig. 4.33 Demodulation of DSB-SC. 

Demodulation of DSB-SC Signals 

The DSB-SC modulation translates or shifts the frequency spectrum to the 
left and the right by ui c (that is, at +ui c and -ur c ), as seen from Eq. (4.70). To 
recover the original signal m(t) from the modulated signal, we must retranslate the 
spectrum to its original position. The process of recovering the signal from the 
modulated signal (retranslating the spectrum to its original position) is referred to 
as demodulation, or detection. Observe that if the modulated signal spectrum 
in Fig. 4.31c is shifted to the left and to the right by ui c (and halved), we obtain the 
spectrum illustrated in Fig. 4.33b, which contains the desired baseband spectrum 
in addition to an unwanted spectrum at ±2w c . The latter can be suppressed by a 
lowpass filter. Thus, demodulation, which is almost identical to modulation, consists 
of multiplication of the incoming modulated signal m(t) cos ui c t by a carrier cos u c t 
followed by a lowpass filter, as depicted in Fig. 4.33a. We can verify this conclusion 
directly in the time-domain by observing that the signal e(t) in Fig. 4.33a is 

e(t) = m(f) cos 2 ui c t 

— jlWO + m (0 cos 2 ui c t] (4.72a) 

(The term suppressed carrier does not necessarily mean absence of the spectrum at the carrier 
frequency. The term “suppressed carrier” merely implies that there is no discrete component of 
the carrier frequency. Since no discrete component exists, the spectrum of DSB-SC does not have 
impulses at ±oj c , a fact which further implies that the modulated signal m(t) cos ui c t does not 
contain a term of the form fccos ui c t (assuming that m(t) has a zero mean value). 
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Therefore, the Fourier transform of the signal e(f) is 
1 1 

E(w) = -M(oj) + ~[M{ui + 2ui c ) + M(u> - 2ui c )\ (4.72b) 

Hence, e(t) consists of two components %m(t) and \m(t) cos 2 ui c t, with their spec- 
tra, as illustrated in Fig. 4.33b. The spectrum of the second component, being 
a modulated signal with carrier frequency 2w c , is centered at ±2ui c . Hence, this 
component is suppressed by the lowpass filter in Fig. 4.33a. The desired component 
being a lowpass spectrum (centered at ui = 0), passes through the filter 
unharmed, resulting in the output |m(t). 

A possible form of lowpass filter characteristics is depicted (dotted) in Fig. 4.33b. 
This method of recovering the baseband signal is called synchronous detection, 
or coherent detection, where we use a carrier of exactly the same frequency (and 
phase) as the carrier used for modulation. Thus, for demodulation, we need to gen- 
erate a local carrier at the receiver in frequency and phase coherence (synchronism) 
with the carrier used at the modulator. We shall demonstrate in Example 4.18 that 
both, the phase and frequency synchronism, are extremely critical. 

I Example 4.18 

Discuss the effect of lack of frequency and phase coherence (synchronism) between 
the carriers at the modulator (transmitter) and the demodulator (receiver) in DSB-SC. 

Let the modulator carrier be cos ui c t (Fig. 4.31a). For the demodulator in Fig. 4.33a, 
we shall consider two cases: (1) the first case with carrier cos ( u c t + 9) (phase error of 9) 
and (2) the second case with carrier cos (uic + Aw)f (frequency error Aw). 

(a) With the demodulator carrier cos (ui c t + 9) (instead of cos u c t) in Fig. 4.33a, the 
multiplier output is e(t) = m(t) cos ui c tcos(ui c t + 9) instead of m(t) cos 2 ui c t. Using the 
trigonometric identity, we obtain 

e{t) = m(t ) cos ui c t cos ( ui c t + 9) 

~ ^m(*)[cos 9 + cos (2 ui c t + 9) ) 

The spectrum of the component ±m(t) cos (2ui c t + 9) is centered at ±2w c . Consequently, 
it will be filtered out by the lowpass filter at the output. The component \m(t) cos 6 
is the signal m(t ) multiplied by a constant § cos 9. The spectrum of this component is 
centered at ui = 0 (lowpass spectrum), and will pass through the lowpass filter at the 
output, yielding the output |m(t) cos 9. 

If 9 is constant, the phase asynchronism merely yields an attenuated output (by a 
factor cos 9). Unfortunately, in practice, 9 is often the phase difference between the carriers 
generated by two distant generators, and varies randomly with time. This variation would 
result in an output whose gain varies randomly with time. 

(b) In the case of frequency error, the demodulator carrier is cos (u) c + A ui)t. This 
situation is very similar to the phase error case in (a) with 9 replaced by (A ui)t. Following 
the analysis in part (a), we can express the demodulator product e(t) as 

e(i) = m(t) cos ui c t cos ( ui c + Aw)f 

= ^m(t) [cos (A ui)t + cos (2 ui c + Aw)t] 
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The spectrum of the component \m(t) cos (2u c + A ui)t is centered at ±(2w c + Aw). Con- 
sequently, this component will be filtered out by the lowpass filter at the output. The 
component \m(t) cos (A ui)t is the signal m(t) multiplied by a low frequency carrier of 
frequency A u>. The spectrum of this component is centered at ±Aiu. In practice, the 
frequency error (Au) is usually very small. Hence, the signal |m(t) cos (Aui)t (whose 
spectrum is centered at ±Au) is a lowpass signal and passes through the lowpass filter at 
the output, resulting in the output |m(t) cos (A ui)t. The output is the desired signal m(t) 
multiplied by a very low frequency sinusoid cos (A u>)t. Clearly, the output in this case is 
not merely an attenuated replica of the desired signal m(t), but represents m(t) multiplied 
by a time- varying gain cos (Au >)t. If, for instance, the transmitter and the receiver carrier 
frequencies differ just by 1 Hz, the output will be the desired signal m(t ) multiplied by 
a time-varying signal whose gain goes from the maximum to 0 every half second. This 
is like some restless child fiddling with the volume control knob of a receiver, going from 
maximum volume to zero volume every half second. This kind of distortion (called the 
beat effect) is beyond repair. I 

4.7-2 Amplitude Modulation (AM) 

For the suppressed carrier scheme just discussed, a receiver must generate a 
carrier in frequency and phase synchronism with the carrier at the transmitter that 
may be located hundreds or thousands of miles away. This situation calls for a 
sophisticated receiver, which could be quite costly. The other alternative is for 
the transmitter to transmit a carrier A cos u c t [along with the modulated signal 
m(t) cos u c t] so that there is no need to generate a carrier at the receiver. In this 
case the transmitter needs to transmit much larger power, a rather expensive pro- 
cedure. In point-to-point communications, where there is one transmitter for each 
receiver, substantial complexity in the receiver system can be justified, provided 
there is a large enough saving in expensive high-power transmitting equipment. On 
the other hand, for a broadcast system with a multitude of receivers for each trans- 
mitter, it is more economical to have one expensive high-power transmitter and 
simpler, less expensive receivers. The second option (transmitting a carrier along 
with the modulated signal) is the obvious choice in this case. This is the so-called 
AM (amplitude modulation), in which the transmitted signal y> AM (f) is given by 


p AM (i) = A cos u c t + m(f) cos u c t (4.73a) 

= [A + m(f)] cos u c t (4.73b) 

Recall that the DSB-SC signal is m(t) cos u/ c t. From Eq. (4.73b) it follows that 
the AM signal is identical to the DSB-SC signal with A + m(t) as the modulating 
signal [instead of m(f)]. Therefore, to sketch <p AM (f), we sketch A + m(t) and 
-[A +m(t)J and fill in between with the sinusoid of the carrier frequency. Two cases 
are considered in Fig. 4.34. In the first case, A is large enough so that A +m(f) > 0 
(is nonnegative) for all values of t. In the second case, A is not large enough to 
satisfy this condition. In the first case, the envelope (Fig. 4.34d) has the same shape 
as m(t) (although riding on a dc of magnitude A). In the second case the envelope 
shape is not m(t), for some parts get rectified (Fig. 4.34e). Thus, we can detect 
the desired signal m(t ) by detecting the envelope in the first case. In the second 
case, such a detection is not possible. We shall see that the envelope detection is 
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Fig. 4.34 AM signal and its envelope. 

an extremely simple and inexpensive operation, which does not require generation 
of a local carrier for the demodulation. But as seen above the envelope of AM has 
the information about m(t) only if the AM signal [A + m(i)]cos u c t satisfies the 
condition A + m{t) > 0 for all t. Thus, the condition for envelope detection of an 
AM signal is 

A+m(t)>0 for all t (4-74) 

If m p is the peak amplitude (positive or negative) of m(f) (see Fig. 4.34), then 
m(t) > —m p . Hence, the condition (4.74) is equivalent tof 


A >m p (4.75) 

Thus the minimum carrier amplitude required for the viability of envelope detection 
is m p . This point is clearly illustrated in Fig. 4.34. 

We define the modulation index n as 


TO-, 

= -f (4.76) 


fin case the negative and the positive peak amplitudes are not identical, m p in condition (4.75) 
is the absolute negative peak amplitude. 
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where A is the carrier amplitude. Note that m p is a constant of the signal m(t). 
Because A > m p and because there is no upper bound on A, it follows that 


0 < m < 1 (4.77) 

as the required condition for the viability of demodulation of AM by an envelope 
detector. 

When A < m p , Eq. (4.76) shows that fi > 1 (overmodulation). In this case, the 
option of envelope detection is no longer viable. We then need to use synchronous 
demodulation. Note that synchronous demodulation can be used for any value of 
M (see Prob. 4.7-4). The envelope detector, which is considerably simpler and less 
expensive than the synchronous detector, can be used only for n < 1. 

B Example 4.19 

Sketch <p AM {t) for modulation indices of p = 0.5 (50% modulation) and p = 1 (100% 
modulation), when m(t) = Bcosui m t. This case is referred to as tone modulation 
because the modulating signal is a pure sinusoid (or tone). 

In this case, m p = B and the modulation index according to Eq. (4.76) is 


h = 


B 

A 


Hence, B = fxA and 

m(t) = B cos u) m t = pAcos u m t 

Therefore 

¥>am W = (A + m(t)j cos u c t = A[1 + pcos ui m t\ cos u c t (4.78) 



Fig. 4.35 Tone-modulated AM (a) ft = 0.5. (b) ft = 1. 


Figures 4.35a and b show the modulated signals corresponding to ft = 0.5 and ft = 1, 
respectively. I 

Demodulation of AM: The Envelope Detector 

The AM signal can be demodulated coherently by a locally generated carrier 
(see Prob. 4.7-4). However, coherent, or synchronous, demodulation of AM (with 
ft < 1) will defeat the very purpose of AM and, hence, is rarely used in practice. 
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We shall consider here one of the noncoherent methods of AM demodulation, the 
envelope detection.! 

In an envelope detector, the output of the detector follows the envelope of the 
(modulated) input signal. The circuit illustrated in Fig. 4.36a functions as an en- 
velope detector. During the positive cycle of the input signal, the diode conducts 
and the capacitor C charges up to the peak voltage of the input signal (Fig. 4.36b). 
As the input signal falls below this peak value, the diode is cut off, because the 
capacitor voltage (which is very nearly the peak voltage) is greater than the input 
signal voltage, a circumstance causing the diode to open. The capacitor now dis- 
charges through the resistor R at a slow rate (with a time constant RC). During 
the next positive cycle, the same drama repeats. When the input signal becomes 
greater than the capacitor voltage, the diode conducts again. The capacitor again 
charges to the peak value of this (new) cycle. As the input voltage falls below the 
new peak value, the diode cuts off again and the capacitor discharges slowly during 
the cutoff period, a process that changes the capacitor voltage very slightly. 


fT here are also other methods of noncoherent detection. The rectifier detector consists of a rectifier 
followed ^by a lowpass filter. This method is also simple and almost as inexpensive as the envelope 
detector . The nonlinear detector, although simple and inexpensive, results in a distorted output. 
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In this manner, during each positive cycle, the capacitor charges up to the peak 
voltage of the input signal and then decays slowly until the next positive cycle. 
Thus, the output voltage vc(t ) follows the envelope of the input. The capacitor 
discharge between positive peaks, however, causes a ripple signal of frequency oj c 
in the output. This ripple can be reduced by increasing the time constant RC so 
that the capacitor discharges very little between the positive peaks (RC < l/w c ). 
Making RC too large, however, would make it impossible for the capacitor voltage 
to follow the envelope (see Fig. 4.36b). Thus, RC should be large compared to 
1 /<j c but should be small compared to l/27rB, where B is the highest frequency in 
m(i). Incidentally, these two conditions also require that w c 2> 27rB, a condition 
necessary for a well-defined envelope. 

The envelope-detector output vc(t) is A + m(t) plus a ripple of frequency u c . 
The dc term A can be blocked out by a capacitor or a simple RC highpass filter. 
The ripple may be reduced further by another (lowpass) RC filter. In the case 
of audio signals, the speakers cannot respond to the high frequency ripple, and 
therefore, they act as lowpass filters themselves. 

4.7-3 Single Sideband Modulation (SSB) 

Figures 4.37a and 4.37b show the baseband spectrum M(w), and the spectrum 
of the DSB-SC modulated signal m(t) cos u> c t. The DSB spectrum in Fig. 4.37b 
has two sidebands: the upper sideband (USB) and the lower sideband (LSB), both 
containing complete information of M(u) [see Eq. (4.10)]. Clearly, it is redundant 
to transmit both sidebands, a process which requires twice the bandwidth of the 
baseband signal. A scheme where only one sideband is transmitted is known as sin- 
gle sideband (SSB) transmission, which requires only one-half the bandwidth 
of the DSB signal. Thus, we transmit only the upper sidebands (Figures 4.37c) or 
only the lower sidebands (Fig. 4.37d). 

An SSB signal can be coherently (synchronously) demodulated. For example, 
multiplication of a USB signal (Fig. 4.37c) by cos u c t shifts its spectrum to the left 
and to the right by cj c , yielding the spectrum in Fig. 4.37e. Lowpass filtering of 
this signal yields the desired baseband signal. The case is similar with LSB signal. 
Hence, demodulation of SSB signals is identical to that of DSB-SC signals, and the 
synchronous demodulator in Fig. 4.33a can demodulate SSB signals. Note that we 
are talking of SSB signals without an additional carrier. Hence, they are suppressed 
carrier signals (SSB-SC). 

I Example 4.20 

Find the USB (the upper sideband) and LSB (the lower sideband) signals when 
m(t ) = cos w m t. Sketch their spectra, and show that these SSB signals can be demodulated 
using the synchronous demodulator in Fig. 4.33a. 

The DSB-SC signal for this case is 

^dsb-sc ( £ ) = m ( £ ) cos u c t 
— cos t cos 

i[cos (ulc — Ul m )t + cos (ui c + U 1 m )t] (4.79) 

As pointed out in Example 4.17, the terms |cos(u; c + a ; m )£ and ^cos(u; c — u) m )t 
represent the upper and lower sidebands, respectively. Figure 4.38a and b show the spectra 
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filter. For instance, the USB signal in Fig. 4.38a can be obtained by passing the DSB-SC 
signal (Fig. 4.32b) through a highpass filter of cutoff frequency ui c . Similarly, the USB 
signal in Fig. 4.38b can be obtained by passing the DSB-SC signal through a lowpass filter 
of cutoff frequency ui c - 

If we apply the LSB signal jCOs(u;c - u) m )f to the synchronous demodulator in 
fig. 4.33a, the multiplier output is 


e(t) = — cos (w c — w m )t cos ui c t 

= ^[cos LJ m t + cos (2u c — tu m )t] 

The term i cos (2w e — ui m )t is suppressed by the lowpass filter, a fact which results in the 
desired output I cos w m t (which is m(t)/ 4). The spectrum of this term is jr[i(u + u>o) + 
S(ui - coo)]/4, as depicted in Fig. 4.38c. In the same way we can show that the USB signal 
can be demodulated by the synchronous demodulator. 

In frequency-domain, demodulation (multiplication by cos u> c t amounts to shifting the 
LSB spectrum (Fig. 4.38b) to the left and the right by ui c (times one-half) and then sup- 
pressing the high frequency, as illustrated in Fig. 4.38c. The resulting spectrum represents 
the desired signal I 



Generation of SSB Signals 

Two methods are commonly used to generate SSB signals. The first method, 
the selective-filtering method uses sharp cutoff filters to eliminate the undesired 
sideband, and the second method uses phase-shifting networks 4 to achieve the same 
goal.) We shall consider here only the first method. 

The selective-filtering Method is the most commonly used method of generating 
SSB signals. In this method, a DSB-SC signal is passed through a sharp cutoff filter 
to eliminate the undesired sideband. 

To obtain the USB, the filter should pass all components above ui c unattenuated 
and completely suppress all components below ui c . Such an operation requires an 
ideal filter, which is unrealizable. It can, however, be realized closely if there is 
some separation between the passband and the stopband. Fortunately, the voice 
signal provides this condition, because its spectrum shows little power content at 
the origin (Fig. 4.39). Moreover, articulation tests show that for speech signals, 
frequency components below 300 Hz are not important. In other words, we may 
suppress all speech components below 300 Hz without affecting the intelligibility 

(Yet another method, known as Weaver’s method, is also used to generate SSB signals. 
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appreciably.): Thus, filtering of the unwanted sideband becomes relatively easy 
for speech signals because we have a 600 Hz transition region around the cutoff 
frequency u c . For signals, which have considerable power at low frequencies (around 
u> = 0), SSB techniques cause considerable distortion. Such is the case with video 
signals. Consequently, for video signals, instead of SSB, we use another technique, 
the vestigial sideband (VSB), which is a compromise between SSB and DSB. 
It inherits the advantages of SSB and DSB but avoids their disadvantages. VSB 
signals are relatively easy to generate, and their bandwidth is only slightly (typically 
25%) greater than that of the SSB signals. In VSB signals, instead of rejecting one 
sideband completely (as in SSB), we accept a gradual cutoff off of one sideband 4 . 


4.8 Angle Modulation 

A sinusoid is characterized by its amplitude and angle (which includes its fre- 
quency and phase). In amplitude modulated signals, the information content of the 
baseband (message) signal m(t) appears in the amplitude variations of the carrier. 
In angle modulation discussed in this section, the information content of m (t) 
is carried by the angle of the carrier. Angle modulation also goes by the name 
exponential modulation. 

The generalized angle modulated (or exponentially modulated) carrier can be 
described as 

¥>em( 0 = 4 cosset + fctf(t)] (4.80) 

where k is an arbitrary constant and ip(t), which is a measure of m(i), is obtained 
by an invertible linear operation on m(t). In other words, ip(t) is the output of 
some linear system with a suitable transfer function H(s) when the input is m(t), 
as depicted in Fig. 4.40.f If h(t) is the unit impulse response of this system; that 
is, if h{t) H(s), then 



Fig. 4.40 Generation of angle modulated signal. 


0(0 = / m(a)h(t — a) da (4.81) 

J — OO 

By selecting suitable h(t), we can obtain a variety of subclasses of angle modula- 
tion. For instance, if we select h(t) = u(t), the resulting form is the well-known 
frequency modulation (FM). In contrast, use of h{t) = 6{t) leads to phase 
modulation (PM). These are but two of the infinite possibilities. Although in 

(Similarly, suppression of speech-signal components above 3500 Hz causes no appreciable change 
in intelligibility. 

(Because H(s) is required to be invertible, we can obtain m{t) by passing i/>(t) through the inverse 
linear system, which has the transfer function 1 /H(s). 
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digital communication, use of phase and frequency modulation is common, the so- 
called broadcast FM is not FM in the classical sense, but is a generalized angle 
modulation because of the inclusion of the preemphasis filter used to improve its 
noise suppressing abilities. It is called FM for historical reason in the sense that 
angle modulation was first conceived and introduced in the form of frequency mod- 
ulation. The broadcast FM, although originating as true FM in the laboratories, 
was modified in broadcasting for better performance. Yet, the term FM continued 
to be used to describe this scheme. 

In amplitude modulation, the carrier frequency is constant, but the amplitude 
changes with m(t). In contrast, in angle modulation, the carrier amplitude is always 
constant, but the carrier frequency varies continuously with the message m(t). By 
definition, a sinusoidal signal is expected to have a constant frequency; hence, the 
variation of frequency with time appears to be contradictory to the conventional 
definition of a sinusoidal signal frequency. Therefore, we must generalize the notion 
of a sinusoid so as to make allowance for variation of frequency with time. This 
generalization leads us to a new concept of instantaneous frequency. 
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Fig. 4.41 Concept of instantaneous frequency. 

4.8-1 The Concept of instantaneous Frequency 

As seen above, the carrier frequency is changing continuously every instant in 
FM. Prima facie, this does not make much sense because to define a frequency, we 
must have a sinusoidal signal at least over one cycle with the same frequency. We 
cannot imagine a sinusoid whose frequency is different at every instant. This prob- 
lem reminds us of our first encounter with the concept of instantaneous velocity 
in our beginning mechanics course. Until that time, we were used to thinking of 
velocity as being constant over a time interval and were incapable of even imagining 
that velocity could vary at each instant. But after some mental struggle, the idea 
gradually sinks in. We never forget, however, the wonder and amazement that was 
caused by the idea when it was first introduced. A similar experience awaits the 
reader with the concept of instantaneous frequency. 

Let us consider a generalized sinusoidal signal <p(t) given by 


4.8 Angle Modulation 


291 


ip(t) = A cos 6(t) (4.82) 

where 6{t), the generalized angle, is a function of t. Figure 4.41 illustrates 
a hypothetical case of 9(t). The generalized angle for a conventional sinusoid 
A cos (u) c t -1- 4> 0 ) is ui c t + i p 0 . This plot, a straight line with a slope u> c and in- 
tercept <t > 0 , is also illustrated in Fig. 4.41. The plot of 9(t) for the hypothetical case 
happens to be tangential to the angle (u c t + 4'o) at some instant t. The crucial point 
is that over a small interval At — * 0, the signal ip(t) = A cos 6(t) and the sinusoid 
A cos (uj c t + <fi 0 ) are identical; that is, 

ip(t) = A cos (u/ c t + 4>o) t\ < t < t 2 

We are certainly justified in saying that over this small interval At, the frequency 
of i p(t), is ui c . Because (w c t -1- 4> 0 ) is tangential to 0(t), the frequency of <p(t) is the 
slope of its angle 9(t) over this small interval. We can generalize this concept at 
every instant and say that the instantaneous frequency u>j at any instant t is the 
slope of 8{t) at t. Thus, for ip(t) in Eq. (4.82), the instantaneous frequency uq(t) is 
given by 

w<(0 = ? (4.83a) 

at 


uii(a ) da 


(4.83b) 


For a conventional sinusoid A cos (u> c t + <t> 0 ), we have 9{t) = u> c t + <j> 0 , and aq(t) = 
d9(t)/dt = u c , a constant, as desired. Clearly, the generalized definition of instan- 
taneous frequency does not conflict with our old notion of frequency. 

Now we can see the possibility of transmitting the information of m(t) by 
varying the angle 9 of a carrier. Two simple possibilities are phase modulation 
(PM) and frequency modulation (FM). In PM, the angle 0(t) is varied linearly 
with m(t) : 

9{t ) = u c t + k v m(t) (4.84a) 

where k p is a constant and io c is the carrier frequency. The resulting PM wave is 


¥> p M (t) = A cos [ui c t + k p m(t ) ] 
The instantaneous frequency u>i(t) in this case is given by 


(4.84b) 


uji(t) = — = u c + k p m(t) (4.84c) 

at 

Hence in phase modulation, the instantaneous frequency w; varies linearly with the 
derivative of the modulating signal. If the instantaneous frequency uq is varied 
linearly with the modulating signal, we have frequency modulation. Thus, in FM, 
the instantaneous frequency oq is 

Wj(t) = uj c + kjm(t) 

where kf is a constant. From Eq. (4.83b), we find the angle 6(t) as 


(4.85a) 



0(0 = f [u> c + kfm(a)] da 
J — OO 

= u c t + kf / m(a)da 
J — OO 


(4.85b) 


Here we have assumed the constant term in 9(t) to be zero without loss of generality. 
Thus, the FM wave is 


V’fm (0 = A cos j ui c t + kfj m(a)da (4.85c) 

Observe that both PM and FM are special cases of the exponentially modulated 
signal <p EM (0 in Eq. (4.80). If h(t) = 6(t) in Eq. (4.81), then use of the sampling 
property of the impulse in Eq. (4.81) yields 4>(t) = m(t), and Eq. (4.80) reduces to 
PM in Eq. (4.84b). Similarly, if h(t) - u(t), then the fact that u(t - a) = 1 over 
-oo < a <t yields f m(a)h(t - a) da = Jm(a)da , and Eq. (4.80) reduces to FM 
in Eq. (4.85c). 



Fig. 4.42 Phase and frequency modulation are inseparable. 


All In The Family 

Equations (4.84b) and (4.85c) indicate that PM and FM are not only very 
similar but are inseparable. Replacing m(t) in Eq. (4.84b) with f m(a) da changes 
PM into FM. Thus, a signal that is an FM wave corresponding to m(t ) is also the PM 
wave corresponding to f m(a) da (Fig. 4.42a). Similarly, a PM wave corresponding 
to m(t) is the FM wave corresponding to rh(f) (Fig. 4.42b). 

We conclude that just by looking at an angle-modulated carrier, we cannot 
tell whether it is FM or PM. In fact, it is meaningless to enquire if a certain angle 
modulated wave is FM or PM. An analogous situation would be to ask a person 
(who is married, with children), whether he is a father or a son. The person would 
be puzzled because he is both, a father (of his child) and a son (of his father). 
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We have seen that PM and FM are not different kind of modulation, but two - 
special cases of generalized angle modulation. Such a view is very fruitful because 
it shows the convertibility of one type of angle modulation (such as PM) to another 
(such as FM). This convertibility is quite clear in Fig. 4.42. For instance, we show 
later that the bandwidth of FM is approximately 2 k f m p , where m p is the peak 
amplitude of m(t). We can derive the equivalent result for PM by referring to 
Fig. 4.42b, which shows that PM is actually the FM when the modulating signal 
is m(i). Clearly, the bandwidth of PM is approximately 2 k p m p \ where m ' is the 
peak amplitude of m(t). This argument shows that if we analyze one type of angle 
modulation (such as FM), we could readily extend those results to any other kind 
Historically, the angle modulation concept began with FM. Hence, it is customary 
to analyze FM and then modify those results for other forms, such as PM. But this 
does not imply that FM is superior to other kinds of angle modulation. On the 
contrary, PM is superior to FM for most analog signals such as audio and video. 
Actually, the optimum performance is realized neither by PM nor FM, but by some 
other form, depending on the nature of the baseband (message) signal. 

This discussion also shows that we need not discuss methods of generation and 
demodulation of each type of modulation. Figure 4.42 clearly indicates that the PM 
can be generated by an FM generator, and the FM can be generated by a PM gener- 
ator. One of the methods of generating FM in practice (the Armstrong indirect-FM 
system) actually integrates m(t) and uses it to phase-modulate a carrier Similar 
remarks apply to demodulation of FM and PM. 





Fig. 4.43 FM and PM waveforms. 


I Example 4.21 

Sketch FM and PM waves for the modulating signal m(t ) depicted in Fig. 4.43a. The 
inn S iuu S kf and k ” 316 27r ^° 5 ^ and 107r ’ res P e ctively, and the carrier frequency JF C is 
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For FM [see Eq. (4.85a)] 

toi = u> c + k/m(t). Dividing throughout by 2 tt, we obtain the equation in terms of 
the variable T (frequency in Hz). The instantaneous frequency Ti is 

Fi = T c + = 10 s + 10 5 m(t) 

2ir 

(T) min = 10 8 - 10 5 |[m(t)]min| = 99.9 MHz 
(^i)max = 10 s + 10 5 [m(t)]max = 100.1 MHz 

Because m(t) increases and decreases linearly with time, the instantaneous frequency in- 
creases linearly from 99.9 to 100.1 MHz over a half-cycle and decreases linearly from 100.1 
to 99.9 MHz over the remaining half-cycle of the modulating signal (Fig. 4.43b). 

For PM 

PM for m(t) is FM for m(t). This assertion also follows from Eq. (4.84c) or Fig. 
4.42b. 

Ti = T c + -Hm (t) = 10 s + 5 m(t) 

ZTT 

(-F i)min = 10 s - 5 |[m(t)] min | = 10 8 - 10 5 = 99.9 MHz 
(Ti)n»x = 10 s + 5 [rh(t)] max = 100.1 MHz 

Because m(t) switches back and forth from a value of -20,000 to 20,000, the carrier 
frequency switches back and forth from 99.9 to 100.1 MHz every half-cycle of ra(f), as 
illustrated in Fig. 4.43d. 

This indirect method of sketching PM (using m(t) to frequency-modulate a carrier) 
works as long as m(t) is a continuous signal. If m(t) is discontinuous, m(t) contains 
impulses, and this method is not so convenient. In such a case, a direct approach should 
be used. This is demonstrated in the next example. H 



(b) (d) 

Fig. 4.44 FM and PM waveforms. 


I Example 4.22 

Sketch FM and PM waves for the digital modulating signal m(t) depicted in Fig. 4.44a. 
The constants kf and k p are 2rr(10 5 ) and ir/2, respectively, and T c = 100 MHz. 
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For FM 

Ti=T . c + ^m(t) = 10 s + 10 5 m(f) 

2sr 

Because m(t) switches back and forth from 1 to -1 and vice versa, the FM wave frequency 
switches back and forth from 99.9 MHz to 100.1 MHz and vice versa, as shown in Fig. 4.44b. 
This scheme of a carrier frequency modulation by a digital signal is known as frequency- 
shift keying (FSK), because the information digits are transmitted by shifting the car rier 
frequency. 

For PM 

Ti = Tc + = 10 s + i rh(t) 

Ztt 4 

The derivative m(t) = 0 everywhere except for impulses of strength ±2 at the points of 
discontinuities of m(t) (Fig. 4.44c). This fact means the carrier frequency is T c — 100 
MHz everywhere except at the points of discontinuities, where it changes momentarily by 
infinite amount. It is not immediately apparent how an instantaneous frequency can be 
changed by an infinite amount and then changed back to the original frequency in zero 
time. Let us consider the direct approach. 

¥>pm (*) = ^ cos [ u ct + k p m(t ) j 
= A cos j u> c t + ^-m(t)j 

{ A sin ai c t when m(t) = -1 
—A sin u> c t when m(t) — 1 

This PM wave, illustrated in Fig. 4.44c, has the same frequency T c = 100 MHz everywhere. 
However, there are phase discontinuities of 7r radians at the instants where impulses of m(t) 
are located. At these instants, the carrier phase shifts by ir instantaneously. A finite phase 
shift in zero time implies infinite instantaneous frequency ( d6/d.t = oo) at these instants. 
This conclusion agrees with our observation about m(t). 

This scheme of carrier phase modulation by a digital signal is called phase-shifting 
keying (PSK), because information digits are transmitted by shifting the carrier phase. 
Note that PSK may also be viewed as a DSB-SC modulation by m(t). 

The amount of phase discontinuity in i p PM ( t ) at the instant where m(t) is discontin- 
uous is kprrid, where m d is the amount of discontinuity in m(t) at that instant. In the 
present example, the amplitude of m(t ) changes by 2 (from -1 to 1) at the discontinuity. 
Hence, the phase discontinuity in '-p PM (t) is k p md ~ f (2) — 7r radians, which confirms our 
earlier result. 

When m(t) is a digital signal (as in Fig. 4.44a), v PM (t) shows a phase discontinuity 
where m(t) has a jump discontinuity. In such a case the phase deviation k p m{t) must be 
restricted to a range (— tt, 7r) in order to avoid ambiguity in demodulation. For example, 
if k p were 3 jt/ 2 in the present example, then 

¥’ pm (*) = Acos jw c t + ym(t)J 

In this case y , PM (t) = Asin u c t when m(t) = 1 or —1/3. This will certainly cause ambi- 
guity at the receiver when Asin w c t is received. Such ambiguity never arises if k p m(t) is 
restricted to the range (-rr, n). 

The ambiguity arises only when m(t) has jump discontinuities. In such a case, the 
phase of tp PM (t) changes instantaneously. Because a phase <p 0 + 2nw is indistinguishable 
from the phase <p 0 , ambiguities will be inherent in the demodulator unless the phase 
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variations are limited to the range (— n, it). For this reason k p should be small enough to 
restrict the phase change k p m(t) to the range (-tt, it). 

No such restriction on k p is required if m(t ) is continuous. In this case the phase 
change is not instantaneous, but gradual over a time, and a phase + 2nrr will exhibit 
n additional carrier cycles over the case of phase of only y>„. This conclusion can also be 
verified from Example 4.21, where the maximum phase change A tp = 10ir. 

Because a bandlimited signal cannot have jump discontinuities, we can say that when 
m(t) is bandlimited, k p has no restrictions. B 

4.8-2 Bandwidth of Angle-Modulated Signals 

Unlike amplitude modulation, there is no simple relationship between the base- 
band signal waveform and the corresponding angle modulated waveform. The same 
is true of their spectra. Because of nonlinear nature of angle modulation, derivation 
of ^ EM (w), the frequency spectrum of the modulated signal is extremely compli- 
cated and can be obtained only for few special cases. Generally, the bandwidth of 
an angle modulated signal is infinite even when the baseband signal bandwidth is 
finite. However, most of the signal power (or energy) resides in a finite band. We 
shall now try to estimate this essential bandwidth of an angle modulated signal. 

Let us start with the angle modulated signal in Eq. (4.80), and consider first 
the case of small k (k — * 0). 

<P EU (0 = A cos + ki>(t)) 

= A cos w c f cos [k0 (f )] - A sin w c t sin [k i> (t )] 

A cos w c t - Akip(t) sin u c t k — > 0 (4.86) 

Comparison of the right-hand side expression with in Eq. (4.73a) shows 

that the two expressions are very similar. The first term is the carrier, and the 
second term, representing the sidebands, has the same form as the DSB-SC signal 
corresponding to the baseband signal Akip(t). The only difference is that the carrier 
is sine instead of cosine. This is just a matter of carrier phase difference of 7r/2. 
Hence, the bandwidth of the angle modulated signal is the same as that of AM 
signal corresponding to the baseband signal i)> (t). If m(t ) is bandlimited to B Hz, 
then the bandwidth of V’(t) is also B Hz.f Hence, the bandwidth of <p EM (<) is 2 B 
Hz, the same as that of AM. But this true only when k —> 0. Let us now consider 
the general case. 

In angle modulation, the carrier frequency is varied from its quiescent value 
w c . Let the maximum deviation of the carrier frequency be Aw. In other words, 
the carrier frequency varies in the range from w c — Au to u c + Au. Because the 
carrier frequency always remains in this band of width 2 Aw radians/s, could we say 
that the resulting spectrum also remains within this band and the bandwidth of 
the angle modulated signal is 2 Aw? This assertion implies that if a sinusoid takes 
an instantaneous frequency u x , the resulting spectrum is concentrated only at u x . 
This is true only if the carrier has infinite duration. For a finite duration sinusoid of 


(Because ifi(t) is the output of a linear system when the input is m(t), the bandwidth of i>{t) 
cannot be greater than B Hz. Moreover, the filter is invertible. Hence, the filter bandwidth 
cannot be less than B Hz, or some of the components of m(t) will be lost. So, the bandwidth of 
i j}(t) cannot be less than B Hz. Hence, it is exactly equal to B Hz. 
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frequency u x , the spectrum is not concentrated at u x , but spreads out on both sides 
of u x , as can be seen from Fig. 4.24d in Example 4.12. In a typical angle modulated 
signal, the carrier frequency is directly proportional to m(f), which changes with 
t. Hence, the instantaneous frequency will also change with t continuously. Such 
continuous shift in frequency will cause the spectral spread beyond the band 2 Aw. 
Clearly, the bandwidth of the angle modulated signal is somewhat larger than 2Aw 
rads/s. How much larger? This missing link can be found by looking at the results 
derived earlier for the case of k — * 0. Let us first determine Aw. 

FVom Eq. (4.80), it follows that 


Ui{t) = w c + fcV>(t) (4.87) 

if the peak amplitude of t/>(t) is denoted by ip p , then the carrier frequency varies in 
the range from w c - krj.’' p to w„ + kip ' p f Therefore 


Aw = fci/'p (4.88a) 

The carrier frequency deviation AT in Hz is 

. _ Aw k , 

Ajf= 27 = ^ (488b) 

As demonstrated earlier, because of spectral spreading, the angle modulated signal 
bandwidth is somewhat larger than 2A T. Let the actual bandwidth B E m in Hz be 


B E m = 2A T + X 

= ^p + x (4-89) 

where X is unknown. To determine X , recall that for the case fc -* 0, we found the 
bandwidth to be 2 B. But as Eq. (4.89) indicates, this bandwidth is X when k — * 0. 
Therefore, X = 2B, and 

B E m = 1(AT + B ) Hz (4.90) 

A more rigorous derivation of this result appears in reference 4. Note that when 
k — > 0, AT — * 0 and AT -c B. On the other hand when k is very large, AT B. 
The former case is known as the narrowband angle modulation and the latter is 
known as the wideband angle modulation. 

Recall that for FM, ip(t) = ra(t), and V > p = m v , where m p is the peak amplitude 
of m{t). Similarly, for PM, ip(t) = m(t). Hence, i/? = m p , where m' p is the peak 
amplitude of m(t). Thus 


(A^)fm = — m p and (A^Jpm = — m' (4.91) 

TT 7T * 

We observe an interesting fact in angle modulation. The bandwidth of the 
modulated signal is adjustable by choosing suitable value of AT or the constant k 
( kj in FM or k p in PM). Amplitude modulation lacks this feature. The bandwidth 
of each AM scheme is fixed. It is a general principle in communication theory 

(This assertion implies an assumption ip(t)\ max = |</>(t)| mm l 


298 


4 Continuous-Time Signal Analysis: The Fourier Transform 


that widening a signal bandwidth makes the signal more immune to noise during 
transmission. Thus, widening the transmission bandwidth makes angle modulated 
signals can be made more immune to noise. Moreover, this very property allows 
us to reduce the signal power required to achieve the same quality of transmission. 
Thus, angle modulation allows us to exchange signal power for bandwidth. 

Also, because of its constant amplitude, angle modulation has a major advan- 
tage over amplitude modulation. This feature makes angle modulation less suscep- 
tible to nonlinear distortion. We shall see in the following section (Sec. 4.8-3) that 
no distortion results when we pass an angle modulated signal through a nonlinear 
device whose output y(t) and the input x(t) are related by y(t) = x 2 (t) [in general 
y(t) — S a n2 n (i)]- Such a nonlinearity can be disastrous in amplitude modulated 
systems. This is the primary reason why angle modulation is used in microwave 
relay systems, where nonlinear operation of amplifiers and other devices has thus 
far been unavoidable at the required high power levels. In addition, the constant 
amplitude of FM gives it a kind of immunity against rapid fading. The effect of 
amplitude variations caused by rapid fading can be eliminated by using automatic 
gain control and bandpass limiting 4 . Angle modulation is also less vulnerable than 
amplitude modulation to small interference from adjacent channels. But the price 
for all these advantages is paid in terms of increased bandwidth. We can demon- 
strate that for the same bandwidth, the pulse code modulation (PCM), discussed 
in Chapter 5, is superior to angle modulation 4 . 

4.8-3 Generation and Demodulation of Angle Modulated Signals. 

In Eq. (4.86), we see that a narrowband angle (or exponential) modulated 
signal (NBEM) consists of a carrier term and a DSB-SC term whose carrier has 
a 7r/2 phase shift. Hence, we can readily generate this signal using the procedure 
discussed in Sec. 4.7. Wideband modulation (WBEM) can be obtained from NBEM 
by passing the NBEM signal through a nonlinear device. Consider, for example, a 
nonlinear device whose input x(t) and the output j/(f) are related by y(t) = x 2 {t). 
If the input is an angle modulated signal cos [ u c t + JfcV>(t)], then the output y(t ) is 
given by 

y(t) = cos 2 [u <: t + fcr/>(t)] 

= - + - cos [2 u c t + 2kip(t)\ 

If we pass this signal through a bandpass filter centered at 2u> c , the output is 
z(t) = - cos [2 u c t + 2kip(t)} 

Observe that the second order of nonlinearity has doubled the carrier frequency as 
well as the effective value of fc without causing any distortion. In a similar way, we 
can show that an nth-order of nonlinearity increases n-fold the carrier frequency 
as well as the effective value of k. This fact allows us the convert the NBEM into 
WBEM. This is the indirect method of generating angle modulated signal. 

We can also generate angle modulated signal by a direct method, which uses 
a voltage controlled oscillator (VCO). The output of a VCO is a constant 
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amplitude sinusoid, whose instantaneous frequency is directly proportional to an 
input voltage m(f). Clearly, a VCO is an FM generator. As demonstrated earlier, 
FM generator, with minor modification, can be used to generate any other form of . 
angle modulation. 

Demodulation 

We shall discuss here demodulation of FM waves. As explained earlier, FM 
demodulator, with some minor modification, can be used for demodulation of any 
other form of angle modulation. Because the instantaneous frequency of FM wave 
is proportional to the baseband signal m(f), an FM demodulator is a device whose 
output is proportional to frequency of the input signal. Thus, the gain H(w) of 
an ideal FM demodulator is of the form ciu> + ci- An ideal differentiator has 
this property. If the input to an ideal differentiator is an angle modulated signal 
x(t) = cos[w c f + kxp(t)], the output y(t) is given by 

, , dx(t) , . , 

vM — — dt - ~[u c + ki/)(t)\ sin [u c t + kip(t)\ 

= [u c + kip(t)\ sin [u c t + kip(t) + ir] 

The output is also an angle modulated signal, whose envelope is w c + kij/(t). Hence, 
an ideal differentiator followed by an envelope detector will result in the output 
u c +kip(t). After blocking the dc,_we obtain the desired output ki>{t). Recall that for 
FM, rp(t) = f m(a)da. Hence, i>{t) = m(t). Another device that can be used as an 
FM demodulator is a tuned circuit, whose resonant frequency is selected either above 
or below the carrier frequency of the FM signal to be demodulated. The frequency 
response of a tuned circuit (below the resonant frequency) is approximately linear 
with the input frequency (at least over a small band). This scheme suffers from 
the fact that the slope of H(w) of a tuned circuit is linear only over a small band, 
and therefore causes considerable distortion in the output. This fault can partially 
be corrected by a balanced discriminator that uses two resonant circuits, one tuned 
above and the other tuned below u c . 

These days, a phase-locked loop (PLL), whose performance is superior to 
any of the methods discussed here (especially in the large noise environment) has 
become very popular as a demodulator of angle modulated signals because of its 
reasonable cost. More discussion about modulation and demodulation of angle 
modulated signals appears in reference 4. 

A Historical Note 

In the twenties, broadcasting was in its infancy. However, there was a constant 
search for techniques that would reduce noise (static). Now, since the noise power 
is proportional to the modulated signal bandwidth (sidebands), attempts were fo- 
cused on finding a modulation scheme to reduce the bandwidth. It was rumored 
that a new method had been discovered for eliminating sidebands (no sidebands, no 
bandwidth!). The concept of FM, where the carrier frequency would be varied in 
proportion to the message m,(t), appeared quite intriguing. The carrier frequency 
w(t) would be varied with time so that w(t) = u c + km(t), where k is an arbitrary 
constant. The carrier frequency will remain within the band from w c - km p to 
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u c + km p . The spectrum, centered at u> c , would have a bandwidth 2 km p , which is 
controlled by the arbitrary constant k. By using an arbitrarily small k , we could 
make the information bandwidth arbitrarily small. This was a passport to com- 
munication heaven. Unfortunately, the experimental results showed that something 
was seriously wrong somewhere. The FM bandwidth was found to be always greater 
than (at best equal to) the AM bandwidth. In some cases, its bandwidth was several 
times that of AM. 

Careful analysis by Carson showed that the FM bandwidth could never be 
smaller than that of AM; at best equal to that of AM. Unfortunately, Carson did 
not recognize the compensating advantage of FM in its ability to suppress noise. 
Without any justification, he states, “Thus, FM introduces inherent distortion and 
has no compensating advantages whatsoever.” 5 In his later paper he says: “In fact, 
as more and more schemes are analyzed and tested, and as the essential nature 
of the problem is clearly perceivable, we are unavoidably forced to the conclusion 
that static, like the poor, will always be with us.” 6 This opinion of one of the ablest 
mathematicians of the day in the communication industry set back the development 
of FM. The noise-suppressing advantage of FM was later proved by Major Edwin 
H. Armstrong 7 , a brilliant engineer whose contributions to the field of radio systems 
are comparable to those of Hertz and Marconi. It was largely the work of Armstrong 
that was responsible for rekindling the interest in FM. Lamentably, Armstrong, who 
became despondent over the lengthy, most acrimonious, and expensive court battles 
with some titans of the communication industry over his patent rights, committed 
suicide in 1954 by walking out of a window 13 stories above the street. 

4.8-4 Frequency-Division Multiplexing 

Signal multiplexing allows transmission of several signals on the same channel. 
In Chapter 5, we shall discuss time-division multiplexing (TDM), where several 
signals time-share the same channel, such as a cable or an optical fiber. In frequency- 
division multiplexing (FDM), the use of modulation, as illustrated in Fig. 4.45, 
makes several signals share the band of the same channel. Each signal is modulated 
by a different carrier frequency. The various carriers are adequately separated to 
avoid overlap (or interference) between the spectra of various modulated signals. 
These carriers are referred to as subcarriers. Each signal may use a different kind 
of modulation (for example, DSB-SC, AM, SSB-SC, VSB-SC, or even FM or PM). 
The modulated-signal spectra may be separated by a small guard band to avoid 
interference and facilitate signal separation at the receiver. 

When all of the modulated spectra are added, we have a composite signal that 
may be considered as a baseband signal. Sometimes, this composite baseband signal 
may be used to further modulate a high-frequency (radio frequency, or RF) carrier 
for the purpose of transmission. 

At the receiver, the incoming signal is first demodulated by the RF carrier to 
retrieve the composite baseband, which is then bandpass filtered to separate each 
modulated signal. Then each modulated signal is individually demodulated by an 
appropriate subcarrier to obtain all the basic baseband signals. 

4.9 Data Truncation: Window Functions 

We often need to truncate data in diverse situations from numerical computa- 
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Fig. 4.45 Frequency division multiplexing. 


tions to filter design. For example, if we need to compute numerically the Fourier 
transform of some signal, say e~ t u(t), on a computer, we will have to truncate the 
signal e~ t u(t) beyond a sufficiently large value of t (typically five time constants 
and above). The reason is that in numerical computations, we have to deal with 
data of finite duration. Similarly, the impulse response h(t) of an ideal lowpass 
filter is noncausal, and approaches zero asymptotically as |t| — * oo. For a practical 
design, we may want to truncate h(t) beyond a sufficiently large value of |t| to make 
h(t) causal. In signal sampling, to eliminate aliasing, we need to truncate the signal 
spectrum beyond the half sampling frequency u s /2, using an anti-aliasing filter. 
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Again, we may -want to synthesize a periodic signal by adding the first n harmonics 
and truncating all the higher harmonics. These examples show that data truncation 
can occur in both time and frequency domain. On the surface, truncation appears 
to be a simple problem of cutting off the data at a point where it is deemed to be 
sufficiently small. Unfortunately, this is not the case. Simple truncation can cause 
some unsuspected problems. 

Window Functions 

Truncation operation may be regarded as multiplying a signal of a large width 
by a window function of a smaller (finite) width. Simple truncation amounts to 
using a rectangular window w R (t) (Fig. 4.48a) in which we assign unit weight 
to all the data within the window width (|t| < ^), and assign zero weight to all 
the data lying outside the window (\t\ > ^). It is also possible to use a window in 
which the weight assigned to the data within the window may not be constant. In 
a triangular window writ), for example, the weight assigned to data decreases 
linearly over the window width (Fig. 4.48b). 

Consider a signal f(t) and a window function w(t). If f(t) <=> F(w) and 
w (f) <=$ W(u), and if the windowed function f w (t) <=> F w (u), then 

fw(t) = f(t)w(t) and F w (u) = 7 ^ F (u>) * W(u) 

According to the width property of convolution, it follows that the width of F w (u>) 
equals the sum of the widths of F(u>) and W(uj). Thus, truncation of a signal 
increases its bandwidth by the amount of bandwidth of w(t). Clearly, the truncation 
of a signal causes its spectrum to spread (or smear) by the amount of the bandwidth 
of w(t). Recall that the signal bandwidth is inversely proportional to the signal 
duration (width). Hence, the wider the window, the smaller is its bandwidth, and 
the smaller is the spectral spreading. This result is predictable because a wider 
window means we are accepting more data (closer approximation), which should 
cause smaller distortion (smaller spectral spreading). Smaller window width (poorer 
approximation) causes more spectral spreading (more distortion). There are also 
other effects produced by the fact that W (m) is really not strictly bandlimited, and 
its spectrum — * 0 only asymptotically. This causes the spectrum of F w (u) — * 0 
asymptotically also at the same rate as that of W(u), even though the F(u) may 
be strictly bandlimited. Thus, windowing causes the spectrum of F(ui) to leak in 
the band where it is supposed to be zero. This effect is called leakage. These twin 
effects, the spectral spreading and the leakage, will now be clarified by an example. 

For an example, let us take f{t) = cos u>o t and a rectangular window w R (t) = 
rect(£), illustrated in Fig. 4.46b. The reason for selecting a sinusoid for /(f) is 
that its spectrum consists of spectral lines of zero width (Fig. 4.46a). This choice 
will make the effect of spectral spreading and leakage clearly visible. The spectrum 
of the truncated signal f w (t) is the convolution of the two impulses of F(u>) with 
the sine spectrum of the window function. Because the convolution of any function 
with an impulse is the function itself (shifted at the location of the impulse), the 
resulting spectrum of the truncated signal is (1/2tt times) the two sine pulses at 
±w 0 , as depicted in Fig. 4.46c. Comparison of spectra F(u) and F w ( u>) reveals the 
effects of truncation. These are: 

1 The spectral lines of F(u) have zero width. But the truncated signal is spread 

out by 47 t JT about each spectral line. The amount of spread is equal to the 
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width of the mainlobe of the window spectrum. One effect of this spectral 
spreading (or smearing) is that if f(t) has two spectral components of frequen- 
cies differing by less than 4n/T rad/s (2 /T Hz), they will be indistinguishable 
in the truncated signal. The result is loss of spectral resolution. We would like 
the spectral spreading (mainlobe width) to be as small as possible. 

2 In addition to the mainlobe spreading, the truncated signal also has sidelobes, 
which decay slowly with frequency. The spectrum of /(t) is zero everywhere 
except at ±w 0 . On the other hand, the truncated signal spectrum F w (u) is zero 
nowhere because of sidelobes. These sidelobes decay asymptotically as 1/ai. 
Thus, the truncation causes spectral leakage in the band where the spectrum 
of the signal }(t) is zero. The peak sidelobe magnitude is 0.217 times the 
mainlobe magnitude (13.3 dB below the peak mainlobe magnitude). Also, the 
sidelobes decay at a rate 1/w, which is -6 dB/octave (or -20 dB/decade). This 
is the rolloff rate of sidelobes. We want smaller sidelobes with a faster rate 
of decay (high rolloff rate). Figure 4.46d shows \W R (w)\ (in dB) as a function 
of w. This plot clearly shows the mainlobe and sidelobe features, with the first 
sidelobe amplitude -13.3 dB below the mainlobe amplitude, and the sidelobes 
decaying at a rate of -6 dB/octave (or -20 dB per decade). 




304 4 Continuous-Time Signal Analysis: The Fourier Transform 

So far, we have discussed the effect of signal truncation (truncation in time 
domain) on the signal spectrum. Because of time-frequency duality, the effect of 
spectral truncation (truncation in frequency domain) on the signal shape is similar. 

Remedies for Side Effects of Truncation 

For better results, we must try to minimize the truncation’s twin side effects, 
the spectral spreading (mainlobe width) and leakage (sidelobe). Let us consider 
each of these ills. 

1 The spectral spread (mainlobe width) of the truncated signal is equal to the 
bandwidth of the window function w (<). We know that the signal bandwidth 
is inversely proportional to the signal width (duration). Hence, to reduce the 
spectral spread (mainlobe width), we need to increase the window width. 

2 To improve the leakage behavior, we must search for the cause of the slow decay 
of sidelobes. In Chapter 3, we saw that the Fourier spectrum decays as 1/a/ for 
a signal with jump discontinuity, and decays as 1/ui 2 for a continuous signal 
whose first derivative is discontinuous, and so on.j Smoothness of a signal is 
measured by the number of continuous derivatives it possesses. The smoother 
the signal, the faster the decay of its spectrum. Thus, we can achieve a given 
leakage behavior by selecting a suitably smooth window. 

3 For a given window width, the remedies for the two effects are incompatible. 
If we try to improve one, the other deteriorates. For instance, among all the 
windows of a given width, the rectangular window has the smallest spectral 
spread (mainlobe width), but has high level sidelobes, which decay slowly. A 
tapered (smooth) window of the same width has smaller and faster decaying 
sidelobes, but it has a wider mainlobe. t But we can compensate for the in- 
creased mainlobe width by widening the window. Thus, we can remedy both 
the side effects of truncation by selecting a suitably smooth window of sufficient 
width. 

There are several well-known tapered-window functions, such as Bartlett (tri- 
angular), Hanning (von Hann), Hamming, Blackman, and Kaiser, which truncate 
the data gradually. These windows offer different tradeoffs with respect to spectral 
spread (mainlobe width), the peak sidelobe magnitude, and the leakage rolloff rate 
as indicated in Table 4. 3. 8,9 Observe that all windows are symmetrical about the 
origin (even functions of t). Because of this feature, W (u>) is a real function of w, 
that is, lW(u>) is either 0 or tt. Hence, the phase function of the truncated signal 
has a minimal amount of distortion. 

Figure 4.47 shows two well-known tapered-window functions, the von Hann 
(or Hanning) window iohan(z) and the Hamming window iuham(z)- We have 
intentionally used the independent variable x because windowing can be performed 
in time domain as well as in frequency domain; so x could be i or w, depending on 
the application. 

(This result was demonstrated for periodic signals. However, it applies to aperiodic signals also. 
This is because we showed in Chapter 4 that if /r 0 (t) is a periodic signal formed by periodic 
extension of an aperiodic signal /(t), then the spectrum of fr 0 (0 is (1/To times) the samples of 
F(ui). Thus, what is true of the decay rate of the spectrum of /r 0 (t) is also true of the rate of 
decay of F( tv). 

$ A tapered window yields a higher mainlobe width because the effective width of a tapered window 
is smaller than that of the rectangular window (see Sec. 2.7-2 [Eq. (2.67)] for the definition of 
effective width). Therefore, from the reciprocity of the signal width and its bandwidth, it follows 
that the rectangular window mainlobe width is smaller than that of a tapered window. 
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There are hundreds of windows, each with differing characteristics. But the 
choice depends on a particular application. The rectangular window has the nar- 
rowest mainlobe. The Bartlett (triangle) window (also called the Fejer or Cesaro) 
is inferior in all respects to the Hanning window. For this reason it is rarely used 
in practice. Hanning is preferred over Hamming in spectral analysis because it has 
faster sidelobe decay. For filtering applications, on the other hand, the Hamming 
window is the choice because it has the smallest sidelobe magnitude for a given 
mainlobe width. The Hamming window is the most widely used, general purpose 
window. The Kaiser window, which uses 7 0 (o), the Bessel function of the order 0, 
is more versatile and adjustable. Selecting a proper value of a (0 < a < 10) allows 
the designer to tailor the window to suit a particular application. The parameter 
a controls the mainlobe and sidelobe trade-off. When a = 0, the Kaiser window 
is the rectangular window. For a = 5.4414, it is the Hamming window, and when 
a = 8.885, it is the Blackman window. As a increases, the mainlobe width increases 
and the sidelobe level decreases. 


Table 4.3 

Some Window Functions and Their Characteristics 


Rolloff Peak 
Mainlobe Rate Sidelobe 

Window w(t) Width dB/oct Level in dB 


1 Rectangular: rect(y) 

2 Bartlett: A(^y) 

Hanning: 0.5 Jl + cos(2at)j 


Blackman: 0.42 + 0.5 cos (~) + 0.08 cos (^t) 


6 Kaiser 


7 o [< Vl - 4 (*) 2 

iSer ' - L J 0 (a) 1 


< 10 


47T 

T 

—6 

-13.3 

8tt 

T 

-12 

-26.5 

87T 

T 

-18 

-31.5 

8x 

T 

-6 

-42.7 

12? r 

T 

-18 

-58.1 


-6 -59.9 (a = 8.168) 
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4.9-1 Filter Design Using Windows 

We shall design an ideal lowpass filter of bandwidth W rad/s. For this filter, 
the impulse response h(t) = —sine (W t) (Fig. 4.48c) is noncausal and, therefore, 
unrealizable. Truncation of h{t) by a suitable window (Fig. 4.48a) makes it real- 
izable, although the resulting filter is now an approximation to the desired ideal 
filter.) We shall use a rectangular window w R (t) and a triangular (Bartlett) win- 
dow wr(t) to truncate h(t), and then examine the resulting filters. The truncated 
impulse responses h R {t) and hr it) for the two cases are depicted in Fig. (4.48d). 

hn(t) = h(t)w R (t) and h T (t) = h(t)w T (t) 

Hence, the windowed filter transfer function is the convolution of H(uj) with the 
Fourier transform of the window, as illustrated in Fig. 4.48e and f. We make the 
following observations. 

1. The windowed filter spectra show spectral spreading at the edges, and in- 
stead of a sudden switch there is a gradual transition from the passband to 
the stopband of the filter. The transition band is smaller (27 t/T rad/s) for the 
rectangular case compared to the triangular case (4n /T rad/s). 

2. Although H{ui) is bandlimited, the windowed filters are not. But the stopband 
behavior of the triangular case is superior to that of the rectangular case. 
For the rectangular window, the leakage in the stopband decreases slowly (as 
1/u) compared to that of the triangular window (as 1/u 2 ). Moreover, the 
rectangular case has a higher peak sidelobe amplitude compared to that of the 
triangular window. 

4.10 Summary 

In Chapter 3 we represented periodic signals as a sum of (everlasting) sinusoids 
or exponentials (Fourier series) . In this chapter we extended this result to aperiodic 
signals, which are represented by the Fourier integral (instead of the Fourier series). 
An aperiodic signal /(t) may be regarded as a periodic signal with period T 0 -* 
oo, so that the Fourier integral is basically a Fourier series with a fundamental 
frequency approaching zero. Therefore, for aperiodic signals, the Fourier spectra 
are continuous. This continuity means that a signal is represented as a sum of 
sinusoids (or exponentials) of all frequencies over a continuous frequency interval. 
The Fourier transform F(u), therefore, is the spectral density (per unit bandwidth 
in Hz). 

An ever-present aspect of the Fourier transform is the duality between time 
and frequency, which also implies duality between the signal /(t) and its transform 
F(lo). This duality arises because of near-symmetrical equations for direct and 
inverse Fourier transforms. The duality principle has far-reaching consequences 
and yields many valuable insights into signal analysis. 

The scaling property of the Fourier transform leads to the conclusion that the 
signal bandwidth is inversely proportional to signal duration (signal width). Time 

)In addition to truncation, we also need to delay the truncated function by r; in order to render 
it causal. However, the time delay only adds a linear phase to the spectrum without changing the 
amplitude spectrum. For this reason, we shall ignore the delay in order to simplify our discussion. 
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shifting of a signal does not change its amplitude spectrum, but adds a linear phase 
spectrum. Multiplication of a signal by an exponential e^ ot results in shifting the 
spectrum to the right by ujq. In practice, spectral shifting is achieved by multi- 
plying a signal with a sinusoid such as cos uig t (rather than the exponential e ] 0 ). 
This process is known as amplitude modulation. Multiplication of two signals re- 
sults in convolution of their spectra, whereas convolution of two signals results in 
multiplication of their spectra. 

For an LTIC system with the transfer function H(v), the input and output 
spectra F{u) and Y( u) are related by the equation Y(w) = F(u>)H(w). This is 
valid only for asymptotically stable systems. For distortionless transmission of 
a signal through an LTIC system, the amplitude response |#(u>)| of the system 
must be constant, and the phase response lH(u>) should be a linear function of ui 
over a band of interest. Ideal filters, which allow distortionless transmission of a 
certain band of frequencies and suppress all the remaining frequencies, are physically 
unrealizable (noncausal). In fact, it is impossible to build a physical system with 
zero gain [H(u) = 0] over a finite band of frequencies. Such systems (which include 
ideal filters) can be realized only with infinite time delay in the response. 

The energy of a signal /(f) is equal to l/2ir times the area under |F(u) 2 | 
(Parseval’s theorem). The energy contributed by spectral components within a 
band AF (in Hz) is given by |F(w)| 2 AF. Therefore, |F(w)| 2 is the energy spectral 
density per unit bandwidth (in Hz). The energy spectral density |F(uj)| of a signal 
/(f) is the Fourier transform of the autocorrelation function of the signal /(f). 
Thus, a signal autocorrelation function has a direct link to its spectral information. 

The process of modulation shifts the signal spectrum to different frequencies. 
Modulation is used for many reasons: to transmit several messages simultaneously 
over the same channel to utilize channel’s high bandwidth, to effectively radiate 
power over a radio link, to shift signal spectrum at higher frequencies to overcome 
the difficulties associated with signal processing at lower frequencies, to effect the 
exchange of transmission bandwidth and transmission power required to transmit 
data at a certain rate. Broadly speaking there are two types of modulation; am- 
plitude and angle modulation. Each of these two classes has several subclasses. 
Amplitude modulation bandwidth is generally fixed. The bandwidth in angle mod- 
ulation, however, is controllable. The higher the bandwidth, the more immune is 
the scheme to noise. 

In practice, we often need to truncate data. Truncating data is like viewing it 
through a window, which permits a view of only certain portions of the data and 
hides (suppresses) the remainder. Abrupt truncation of data amounts to a rectan- 
gular window, which assigns a unit weight to data seen from the window and assigns 
zero weight to the remaining data. Tapered windows, on the other hand, reduce 
the weight gradually from 1 to 0. Data truncation can cause some unsuspected 
problems. For example, in computation of the Fourier transform, windowing (data 
truncation) causes spectral spreading (spectral smearing) that is characteristic of 
the window function used. A rectangular window results in the least spreading, but 
it does so at the cost of a high and oscillatory spectral leakage outside the signal 
band which decays slowly as 1/cv. Compared to a rectangular window, tapered win- 
dows in general have larger spectral spreading (smearing), but the spectral leakage 
is smaller and decays faster with frequency. If we try to reduce spectral leakage 
by using a smoother window, the spectral spreading increases. Fortunately, the 
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spectral spreading can be reduced by increasing the window width. Therefore, we 
can achieve a given combination of spectral spread (transition bandwidth) and leak- 
age characteristics by choosing a suitable tapered window function of a sufficiently 
longer width T. 


1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 
9. 


4.1-1 


4.1-2 


4.1-3 
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Problems 

Show that if f(t) is an even function of t, then 

POO 

F(u>) = 2 / f(t) cos ut dt 
Jo 

and if /(<) is an odd function of t, then 

POO 

F(w) = —2 j / f(t) sin ut dt 
Jo 

Hence, prove that if f(t) is a real and even function of t, then F(w) is a real and even 
function of u>. In addition, if /(t) is a real and odd function of t, then F(u) is an 
imaginary and odd function of ai. 

Show that for a real f(t), Eq. (4.8b) can be expressed as 

f(t) = — / |F(w)| cos [cut + lF(u>) 1 dui 

n Jo 

This is the trigonometric form of the Fourier integral. Compare this with the compact 
trigonometric Fourier series. 

A signal f(t) can be expressed as the sum of even and odd components (see Sec. 
1.5-2): 

/(*) = Ut) + fo(t) 
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Fig. P4.1-5 



Fig. P4.1-7 


(a) If /(f) 4 = 4 - F(ui), show that for real /(t) , 

fe(t) Re[F(w)] and f a (t) <=> j Im[F(u))J 

(b) Verify these results by finding the Fourier transforms of the even and odd com- 
ponents of the following signals: (i) u(t) (ii) e~ at u(t). 

4.1- 4 From definition (4.8a), find the Fourier transforms of the signals /(f) in Fig. P4.1-4. 

4.1- 5 From definition (4.8a), find the Fourier transforms of the signals depicted in Fig. 

P4.1-5. 

4.1- 6 Using Eq. (4.8b), find the inverse Fourier transforms of the spectra in Fig. P4.1-6 

4.1- 7 Using Eq. (4.8b), find the inverse Fourier transforms of the spectra in Fig. P4.1-7. 

4.2- 1 Sketch the following functions: 

(a) rect (|) (b)A(^) (c) rect (^2) (d) sinc(^) (e) sine (i*^) 

(f) sincdJrectfAj). Hint: /(^) is /(f ) right-shifted by a. 

4.2- 2 From definition (4.8a), show that the Fourier transform of rect (t — 5) is 

sine (^)e - ^ 5 “. Sketch the resulting amplitude and phase spectra. 
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Fig. P4.3-2 


4.2- 3 From definition (4.8b), show that the inverse Fourier transform of rect f^lS) is 

sinc(jrf)e> 10 ‘. 2 * ’ 

4.2- 4 Find the inverse Fourier transform of F(u) for the spectra illustrated in Figs. P4.2-4a 

and b. 

Hint: F(uj) = |F(a>)|e' , ' ^F( " , . This problem illustrates how different phase spectra 
(both with the same amplitude spectrum) represent entirely different signals. 

4.3- 1 Apply the symmetry property to the appropriate pair in Table 4.1 to show that 

( a ) 2 [^(0 4- 4 — r u(uj) (b) 6(t 4- T) 4- 6(t — T) 4 =^ 2 cos Tu 

(c)6(t + T) — 6(t — T ) <=^> 2j sin Tui. 

4.3- 2 The Fourier transform of the triangular pulse /(f) in Fig. P4.3-2a is expressed as 

FM=i(e ) "-)^“-l) 

Using this information, and the time-shifting and time-scaling properties, find the 
Fourier transforms of the signals fi(t) ( i = 1, 2, 3, 4, 5) shown in Fig. P4.3-2. 

Hint: See Sec. 1.3 for explanation of various signal operations. Pulses /,(t) (i = 2, 3, 4 
can be expressed as a combination of f(t) and /i(t) with suitable time shift (which 
may be positive or negative). 

4.3- 3 Using only the time-shifting property and Table 4.1, find the Fourier transforms of 

the signals depicted in Fig. P4.3-3. 
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Fig. P4.3-5 


Hint: Signals in Figs, b, c, and d can be expressed in the form f(t)[u(t) - u(t - a)]. 

4.3- 4 Using the time-shifting property, show that if /(t) 4=S> F(w), then 

/(t + T) + f{t -T)<=* 2 F(w) cos To. 

This is the dual of Eq. (4.41). Using this result and pairs 17 and 19 in Table 4.1, find 
the Fourier transforms of the signals shown in Fig. P4.3-4. 

4.3- 5 Prove the following results, which are duals of each other: 

f(t) sin wot 4=> ^[F(w — wo) — F(w + wo)] 

3 j !/(t + T) - f(t - T)] <=4 F(w) sin Tw 

Using the latter result and Table 4.1, find the Fourier transform of the signal in Fig. 
P4.3-5. 

4.3- 6 The signals in Fig. P4.3-6 are modulated signals with carrier cos lOt. Find the Fourier 

transforms of these signals using the appropriate properties of the Fourier transform 
and Table 4.1. Sketch the amplitude and phase spectra for parts (a) and (b). 

4.3- 7 Using the frequency-shifting property and Table 4.1, find the inverse Fourier transform 

of the spectra depicted in Fig. P4.3-7. 

4.3- 8 Using the time convolution property, prove pairs 2, 4, 13 and 14 in Table 2.1 (assume 

A < 0 in pair 2, Ai and A 2 < 0 in pair 4, Ai < 0 and A 2 > 0 in pair 13, and Ai and 
A 2 > 0 in pair 14). Hint: You will need partial fraction expansion. For pair 2, you 
need to apply the result in Eq. (1.23). 



4.3-9 A signal f(t) is bandlimited to B Hz. Show that the signal f n (t) is bandlimited to 
nB Hz. Hint: Start with n = 2. Use frequency convolution property and the width 
property of convolution. 

4.3- 10 Find the Fourier transform of the signal in Fig. P4.3-3a by three different methods: 

(a) By direct integration using the definition (4.8a). 

(b) Using only pair 17 Table 4.1 and the time-shifting property. 

(c) Using the time-differentiation and time-shifting properties, along with the fact 
that S(t) 1. 

Hint: 1 — cos 2x = 2 sin 2 x. 

4.3- 11 (a) Prove the frequency differentiation property (dual of the time differentiation): 

<=> £;F(w) 

(b) Using this property and pair 1 (Table 4.1), determine the Fourier transform of 
te~ at u(t). 

4.4- 1 For an LTIC system with transfer function 

ff W = 7TT 

find the (zero-state) response if the input /(£) is (a) e~ 2t u(t ) (b) e“ £ u(£) 

(c) e l u{—t) (d) u(t) 

Hint: For part (d), you need to apply the result in Eq. (1.23). 

4.4- 2 A stable LTIC system is specified by the transfer function 
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Fig. P4.4-3 


Find the impulse response of this system and show that this is a noncausal system. 
Find the (zero-state) response of this system if the input f(t) is 

(a) e~ t u(t ) (b)e f u(-t). 

4.4- 3 Signals fi{t) = 10 4 rect (10 4 t) and / 2 (t) = 6(t) are applied at the inputs of the ideal 

lowpass filters H\(u) = rect ( 40 ^ 00<r ) and H 2 (w) = rect ( ) (Fig. P4.4-3). The 

outputs j/i (t) and j/ 2 (t) of these filters are multiplied to obtain the signal y(t) = 

(a) Sketch Fi(u) and F 2 (w). 

(b) Sketch Hi(u) and if 2 (uj). 

(c) Sketch yi(u;) and V 2 (a;). 

(d) Find the bandwidths of yi(t),yj(t), and y(t). 

Hint for part (d): Use the convolution property and the width property of convolution 
to determine the bandwidth of yi(t)yi(t). 

4.4- 4 A lowpass system time constant is often defined as the width of its unit impulse 

response h(t) (see Sec. 2.7-2). An input pulse p(t) to this system acts like an impulse 
of strength equal to the area of p(t) if the width of p(t) is much smaller than the system 
time constant. Assume p(f) to be a lowpass pulse, that is its spectrum is concentrated 
at low frequencies. Verify this behavior by considering a system whose unit impulse 
response is h{t) = rect ( 10 -y ). The input pulse is a triangle pulse pit) — A( 10 _# ). 
The area under this pulse is A = 0.5 X 10~ 6 . Show that the system response to this 
pulse is very nearly the system response to the input A6(t). 

4.4- 5 A lowpass system time constant is often defined as the width of its unit impulse 

response h{t) (see Sec. 2.7-2). An input pulse p(f) to this system passes practically 
without distortion, if the width of p(t) is much greater than the system time constant. 
Assume p(t) to be a lowpass pulse, that is its spectrum is concentrated at low fre- 
quencies. Verify this behavior by considering a system whose unit impulse response 
is h(t) - rect ( - fa). The input pulse is a triangle pulse p(t) = A(t). Show that the 
system output to this pulse is very nearly kp(t), where k is the system gain to a dc 
signal, that is, fc = H (0). 

4.4- 6 A causal signal h(t) has a Fourier transform H{u>). If R{u>) and X(w) are the real 

and the imaginary parts of H(u), that is , H(u) = i?(w) + j'X(u>), then show that 



assuming that h(t) has no impulse at the origin. This pair of integrals defines the 
Hilbert transform. 

Hint: Let h e (t) and h a (t) be the even and odd components of h(t). Use results in 
Prob. 4.1-3. See Fig. 1.24 for the relationship between h c {t) and h 0 (t). Recall that 
sgn(t) 2/jw. Use convolution property. 

This problem states one of the important properties of causal systems: that the real 
and imaginary parts of the transfer function of a causal system are related. If one 
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specifies the real part, the imaginary part cannot be specified independently. The 
imaginary part is predetermined by the real part, and vice versa. This result also 
leads to the conclusion that the magnitude and angle of H(lj) are related provided 
all the poles and zeros of H(uj) lie in the LHP. 

4.5- 1 Consider a filter with the transfer function 

H(u>) = 

Show that this filter is physically unrealizable by using the time-domain criterion 
[noncausal h(t)} and the frequency-domain (Paley-Wiener) criterion. Can this filter 
be made approximately realizable by choosing a sufficiently large to? Use your own 
(reasonable) criterion of approximate realizability to determine to- 
Hint: Use pair 22 in Table 4.1. 

4.5- 2 Show that a filter with transfer function 


H(u,) = 


2 ( 10 5 ) .- iutn 

u) 2 4- 10 10 6 


is unrealizable. Can this filter be made approximately realizable by choosing a suffi- 
ciently large to? Use your own (reasonable) criterion of approximate realizability to 
determine to. 

Hint: Show that the impulse response is noncausal. 

4.5-3 Determine if the filters with the following transfer functions are physically realizable. 
If they are not realizable, can they be realized exactly or approximately by allowing 
a finite time delay in the response? 


H{u) = (a) 10" 6 sine (10“ 6 w) (b) 1CT 


40, OOOtt 


(c) 2t6(ui) 


4.6-1 Show that the energy of a Gaussian pulse 


<7V2 it 


is 2 a Verify this result by deriving the energy Ef from F(u) using Parseval’s 
theorem. 

Hint: See pair 22 in Table 4.1. Use the fact that 




4.6-2 Show that 



sine 2 ( kx ) dx 


n 

k 


Hint: Recognize that the integral is the energy of f(t) = sine (kt). Find this energy 
by using Parseval’s theorem. 

4.6-3 A lowpass signal f(t) is applied to a squaring device. The squarer output f 2 {t) is 
applied to a lowpass filter of bandwidth AT Hz (Fig. P4.6-3). Show that if AT is 
very small (AT 0), then the filter output is a dc signal y(t) ss 2E/AT. 
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Fig. P4.6-3 


Hint: If / 2 (t) 4=> A(tu), then show that Y(ui) ss [47rA(0)AF]6(uj) if AF — * 0. Now, 
show that A(0) = E;. 

1.6-4 Generalize Parseval's theorem to show that for real, Fourier transformable signals 
/i(t) and /j(t) 

/ OO 

h(t)f 2 (t)dt = 

■OO 


Fi(— w)F2(cj) du 


2 


Fi(u>)F2(— iu) du) 


4.6-5 


For the signal 


/W = 


2a 


determine the essential bandwidth B Hz of f(t) such that the energy contained in 
the spectral components of f(t) of frequencies below B Hz is 99% of the signal energy 
Ej. Hint: See Exercise E4.5b. 

For each of the following 3 baseband signals (i) m(t) = cos lOOOt (ii) m(t) = 
2 cos lOOOt 4- cos 2000t (iii) m(t) = cos lOOOtcos 30004 


(a) Sketch the spectrum of m(t). 

(b) Sketch the spectrum of the DSB-SC signal m(t) cos 10,000t. 

(c) Identify the upper sideband (USB) and the lower sideband (LSB) spectra. 

(d) Identify the frequencies in the baseband, and the corresponding frequencies in 
the DSB-SC, USB and LSB spectra. Explain the nature of frequency shifting in each 
case. 



Fig. P4.7-2 


4.7-2 You are asked to design a DSB-SC modulator to generate a modulated signal 
km(t) cos u> c t, where m(t) is a signal bandlimited to B Hz (Fig. P4.7-2a). Figure 
P4.7-2b shows a DSB-SC modulator available in the stock room. The bandpass filter 
is tuned to u > c - The carrier generator available generates not cos u> c t, but cos 3 ui c t. 

(a) Explain whether you would be able to generate the desired signal using only this 
equipment. If so, what is the value of fc? 

(b) Determine the signal spectra at points b and c, and indicate the frequency bands 
occupied by these spectra. 

(c) What is the minimum usable value of w c ? 

(d) Would this scheme work if the carrier generator output were cos 2 u> c t? Explain. 

(e) Would this scheme work if the carrier generator output were cos"u> c t for any 
integer n > 2? 
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Fig. P4.7-3 


4.7-3 In practice, the analog multiplication operation is difficult and expensive. For this rea- 
son, in amplitude modulators, it is necessary to find some alternative to multiplication 
of m(t) with cos u>ct. Fortunately, for this purpose, we can replace multiplication with 
switching operation. A similar observation applies to demodulators. In the scheme 
depicted in Fig. P4.7-3a, the period of the rectangular periodic pulse x(t) shown in 
Fig. P4.7-3b is To = 2tt/u> c . The bandpass filter is centered at ±u c . Note that mul- 
tiplication by a square periodic pulse x(t) in Fig. P4.7-3b amounts to periodic on-off 
switching of m(t). This is a relatively simple and inexpensive operation. 

Show that this scheme can generate amplitude modulated signal fc cos ui c t. Determine 
the value of fc. Show that the same scheme can also be used for demodulation provided 
the bandpass filter in Fig. P4.7-3a is replaced by a lowpass (or baseband) filter. 



COSO ) c r 

Fig. P4.7-4 



Fig. P4.7-5 


4.7- 4 Figure P4.7-4 presents a scheme for coherent (synchronous) demodulation. Show that 

this scheme can demodulate the AM signal [A + m(t)] cos t j c t regardless of the value 
of A. 

4.7- 5 Sketch the AM signal [A+m(t)j cos u c t for the periodic triangle signal m(t) illustrated 

in Fig. P4.7-5 corresponding to the modulation index: (a) p = 0.5, (b) p = 1, (c) 
p = 2, and (d) p = oo. How do you interpret the case p — oo? 
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4.7-6 For each of the following three baseband signals (a) m(t) = cos lOOf (b) m(t) = 
cos lOOt + 2 cos 300t (c) m(f) = cos lOOtcos 5001 

(i) Sketch the spectrum of m(t). 

(ii) Find and sketch the spectrum of the DSB-SC signal 1m(t) cos lOOOf. 

(iii) From the spectrum obtained in (ii), suppress the LSB spectrum to obtain the 
USB spectrum. 

(iv) Knowing the USB spectrum in (ii), write the expression <p USB (t) for the USB 
signal. 

(v) Repeat (iii) and (iv) to obtain the LSB signal if> LSB (f). 



Fig. P4.8-1 

4.8-1 Sketch <p FM (t) and <p PM (t ) for the modulating signal m(t) depicted in Fig. P4.8-1, 
given cj c = 2x x 10 7 , kf = 2-rr x 10 5 , and k p = 5Cbr. 



Fig. P4.8-2 

4.8- 2 A baseband signal m(t) is a periodic saw tooth signal shown in Fig. P4.8-2. Sketch 

if> FM (t) and ip p M (f) for this m(t) if — 2i r x 10 6 , kf = 20,0007r, and k v = tt/2. 
Explain why it is necessary to use k v < n in this case. 

4.8- 3 For a modulating signal 

m(t) = 2 cos 1001 + 18 cos 2000irl 

Determine the bandwidths of the corresponding y> FM (f) and <p PM (l) if kf = 10007T 
and k p = 1. 

4.8- 4 An angle-modulated signal is described by the equation 

<p EM (f) = 10 cos (w c f + 0.1 sin 2000irf) 

(a) Find the frequency deviation AF (b) Estimate the bandwidth of ipEM(t). 

4.8- 5 Repeat Prob. 4.8-4 if 

¥>em( 1) = 5 cos (wet + 20 sin 10007rt + 10 sin 20007rf) 



Sampling 


A continuous-time signal can be processed by processing its samples through 
a discrete-time system. For this purpose, it is important to maintain the signal 
sampling rate sufficiently high so that the original signal can be reconstructed from 
these samples without error (or with an error within a given tolerance). The neces- 
sary quantitative framework for this purpose is provided by the sampling theorem 
derived in the following section. 

5.1 The Sampling Theorem 

We now show that a real signal whose spectrum is bandlimited to B Hz 
(F(w) = 0 for |w| > 2i rB] can be reconstructed exactly (without any error) from its 
samples taken uniformly at a rate F s > 2 B samples per second. In other words, 
the minimum sampling frequency is T a = 2 B Hz.f 

To prove the sampling theorem, consider a signal /(f) (Fig. 5.1a) whose spec- 
trum is bandlimited to B Hz (Fig. 5.1b)4 For convenience, spectra are shown as 
functions of w as well as of T (Hz). Sampling /(t) at a rate of T s Hz {JF, samples 
per second) can be accomplished by multiplying /(f) by an impulse train Sx(t)( Fig. 
5.1c), consisting of unit impulses repeating periodically every T seconds, where 
T = 1/F S - The result is the sampled signal /(f) resented in Fig. 5. Id. The sampled 
signal consists of impulses spaced every T seconds (the sampling interval). The nth 
impulse, located at f = nT, has a strength f(nT), the value of /(f) at f = nT. 

7(0 = /(f)fir(t) = £/(" T ) fi ( f - nT) (5.1) 

n 

fThe theorem stated here (and proved subsequently) applies to lowpass signals. A bandpass signal 
whose spectrum exists over a frequency band 7 C - § < \F\ < T c + ^ has a bandwidth of B Hz. 
Such a signal is uniquely determined by 2 B samples per second. In general, the sampling scheme 
is a bit more complex in this case. It uses two interlaced sampling trains, each at a rate of B 
samples per second (known as second-order sampling). See, for example, the references. 1,2 
|The spectrum F(u>) in Fig. 5.1b is shown as real, for convenience. However, our arguments are 
valid for complex F( w) as well. 
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Fig. 5.1 Sampled signal and its Fourier spectrum. 


Because the impulse train /r(f) is a periodic signal of period T , it can be expressed 
as a trigonometric Fourier series already obtained in Example 3.8 [Eq. (3.81)] 

S T (t) = i[l + 2 cos U) s t + 2 cos 2u,t + 2 cos 3w s £ + • • •] = — = 2-nF, (5.2) 

Therefore 

J ( t ) = f(t)6 r {t) = i[/(f) + 2/(f)cos w s f + 2/(f)cos 2u,t + 2/(f) cos 3ui a t + ■ • ■] (5.3) 


To find F{u>), the Fourier transform of f{t), we take the Fourier transform of the 
right-hand side of Eq. (5.3), term by term. The transform of the first term in the 
brackets is F(u). The transform of the second term 2/(£)cos u 3 t is F(u > - u> 4 ) + 
F(u +u> a ) [see Eq. (4.41)]. This represents spectrum F(u>) shifted to u s and -u s . 
Similarly, the transform of the third term 2 /(£) cos 2 u,t is F{w-2u s ) + F{w+2u s ), 
which represents the spectrum F(u>) shifted to 2u/ s and — 2tu s , and so on to infinity. 
This result means that the spectrum F(u) consists of F(w) repeating periodically 
with period ^ rad/s, or Hz, as depicted in Fig. 5.1e. There is also a 

constant multiplier 1/T in Eq. (5.3). Therefore 

1 00 

F(w) = — ^2 F(u-nui s ) (5-4) 

n=— oo 
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If we are to reconstruct /(£) from /(£), we should be able to recover F(uj) from 
F( tu). This recovery is possible if there is no overlap between successive cycles of 
F(ui). Figure 5,le indicates that this requires 

F, > 2 B (5.5) 


Also, the sampling interval T = \jT,. Therefore 


T < — 
~ 2 B 


(5.6) 


Thus, as long as the sampling frequency T s is greater than twice the signal band- 
width B (in hertz), F(lj) will consist of nonoverlapping repetitions of F(u). In 
such a case, Fig. 5.1e indicates that /(£) can be recovered from its samples /(f) 
by passing the sampled signal /(£) through an ideal lowpass filter of bandwidth B 
Hz. The minimum sampling rate F s = 2 B required to recover /(f) from its samples 
/(f) is called the Nyquist rate for /(£), and the corresponding sampling interval 
T = 1/2 B is called the Nyquist interval for /(£).f 


■ Example 5.1 

In this example, we examine the effects of sampling a signal at the Nyquist rate, below 
the Nyquist rate (undersampling) and above the Nyquist rate (oversampling). Consider 
a signal /(£) = sinc 1 2 (5rr£) (Fig. 5.2a) whose spectrum is F(u>) = 0.2A(jgj) (Fig. 5.2b). 
The bandwidth of this signal is 5 Hz (10rr rad/s). Consequently, the Nyquist rate is 10 
Hz; that is, we must sample the signal at a rate no less than 10 samples/s. The Nyquist 
interval is T = 1/2 B = 0.1 second. 

Recall that the sampled signal spectrum consists of (l/T)F(u) = Sjjr Afjjjj) repeat- 
ing periodically with a period equal to the sampling frequency T a Hz. We present this 
information in the following Table for three sampling rates: T, = 5 Hz (undersampling), 
10 Hz (Nyquist rate), and 20 Hz (oversampling). 


sampling frequency Fa 

sampling interval T 

jF(u) | comments 

5 Hz 

0.2 

A ( 2 ^) | Undersampling 

10 Hz 

0.1 

2A ( 5 ^) | Nyquist Rate 

20 Hz 

0.05 

4 A (jjjj) | Oversampling 


In the first case (undersampling), the sampling rate is 5 Hz (5 samples/sec.), and the 
spectrum ^F(ui) repeats every 5 Hz (107r rad/sec.). The successive spectra overlap, as 
depicted in Fig. 5. 2d, and the spectrum F(u) is not recoverable from F(u)\ that is, /(f) 
cannot be reconstructed from its samples /(£) in Fig. 5.2c. In the second case, we use the 
Nyquist sampling rate of 10 Hz (Fig. 5.2e). The spectrum F(ui) consists of back-to-back, 
nonoverlapping repetitions of yF(u) repeating every 10 Hz. Hence, F(ui) can be recovered 
from F(u) using an ideal lowpass filter of bandwidth 5 Hz (Fig. 5.2f). Finally, in the last 
case of oversampling (sampling rate 20 Hz), the spectrum F(u>) consists of nonoverlapping 
repetitions of ^F(w) (repeating every 20 Hz) with empty band between successive cycles 


fWe have proved that for errorfree recovery of a signal of bandwidth B Hz, the sampling rate 
F s > 2 B. However, in a special case, where F(uj) contains an impulse at the highest frequency 
B, the sampling rate must be Fa > 2 B Hz. Such is the case when /(f) = sin 2irBt This signal 
is bandlimited to B Hz, but all of its samples are zero when taken at a rate Fa = 2 B (starting at 
t = 0), and /(£) cannot be recovered from its Nyquist samples. 
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-2nB o 2nS 4 itB w —m. 

Fig. 5.3 Simple interpolation using a zero-order hold circuit. 

Answer: The Nyquist interval is 0.01 second and the Nyquist sampling rate is 100 Hz for both the 
signals, v 

5.1-1 Signal Reconstruction: The Interpolation Formula 

The process of reconstructing a continuous-time signal f(t) from its samples is 
also known as interpolation. In Sec. 5.1, we saw that a signal /(t) bandlimited 
to B Hz can be reconstructed (interpolated) exactly from its samples. This recon- 
struction is accomplished by passing the sampled signal through an ideal lowpass 
filter of bandwidth B Hz. As seen from Eq. (5.3) [or Fig. 5 . 1 e] , the sampled signal 
contains a component ^/(t) and to recover /(t) (or F(w)), the sampled signal must 
be passed through an ideal lowpass filter of bandwidth B Hz and gain T . Thus, the 
reconstruction (or interpolating) filter transfer function is 

*( w ) = rrect( 5 7b) (5 - 7) 

The interpolation process here is expressed in the frequency-domain as a filtering 
operation. Now, we shall examine this process from a different viewpoint, that of 
the time-domain. 

To begin with, let us consider a very simple interpolating filter whose impulse 
response is rect (£), depicted in Fig. 5.3a. This is a gate pulse centered at the origin, 
having unit height, and width T (the sampling interval). We shall find the output 
of this filter when the input is the sampled signal f(t ). Each sample in /(f), being 
an impulse, produces at the output a gate pulse of height equal to the strength of 
the sample. For instance, the fcth sample is an impulse of strength /(kT) located at 
t - kT, and can be expressed as f(kT)6(t — kT). When this impulse passes through 
the filter, it produces at the output a gate pulse of height f(kT), centered at t = kT 
(shown shaded in Fig. 5.3b). Each sample in f(t) will generate a corresponding gate 
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pulse resulting in the filter output that is a staircase approximation of f(t), shown 
dotted in Fig. 5.3b. This filter thus gives a crude form of interpolation. 

The transfer function of this filter H (ui) is the Fourier transform of the impulse 
response rect (y) . Assuming the Nyquist sampling rate; that is, T = 1/2 B 

h(t) = rect ^ 

and 

f/M = r sine (^) = ^ sine (^) (5.8) 

The amplitude response |ff(m)| for this filter, illustrated in Fig. 5.3c, explains the 
reason for the crudeness of this interpolation. This filter, also known as the zero- 
order hold filter, is a poor form of the ideal lowpass filter (shown shaded in Fig. 
5.3c) required for exact interpolation.! 

We can improve on the zero-order hold filter by using the first-order hold 
filter, which results in a linear interpolation instead of the staircase interpolation. 
The linear interpolator, whose impulse response is a triangle pulse A(^), results 
in an interpolation in which successive sample tops are connected by straight line 
segments (see Prob. 5.1-5). 

The ideal interpolation filter transfer function obtained in Eq. (5.7) is illustrated 
in Fig. 5.4a. The impulse response of this filter, the inverse Fourier transform of 
B(a>) is 

h(t) = 2 BT sine (2rr Bt) (5.9a) 

Assuming the Nyquist sampling rate; that is, 2 BT = 1, then 

h(t) = sine (2-nBt) (5.9b) 

This h(t) is depicted in Fig. 5.4b. Observe the very interesting fact that h(t) = 0 
at all Nyquist sampling instants (t = ±^g) except at t = 0. When the sampled 
signal /(f) is applied at the input of this filter, the output is f{t). Each sample in 
/(t), being an impulse, generates a sine pulse of height equal to the strength of the 
sample, as illustrated in Fig. 5.4c. The process is identical to that depicted in Fig. 
5.3b, except that h(t) is a sine pulse instead of a gate pulse. Addition of the sine 
pulses generated by all the samples results in /(f). The kth sample of the input /(f) 
is the impulse }{kT)6(t - kT); the filter output of this impulse is f{kT)h{t - kT). 
Hence, the filter output to /(t), which is /(f), can now be expressed as a sum 

m = E f(kT)h(t - kT) 

k 

= ^/(fcT) sine [2x5(1 - fcT)) (5.10a) 

k 

— f(kT) sine (2itBt — kit) (5.10b) 

k 

fFigure 5.3a shows that the impulse response of this filter is noncausal, and this filter is not 
realizable. In practice, we make it realizable by delaying the impulse response by T/2. This 
merely delays the output of the filter by T/2. 


^ = rect (2Bf) 
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Fig. 5.4 Ideal interpolation. 

Equation (5.10) is the interpolation formula, which yields values of /(f) between 
samples as a weighted sum of all the sample values. 

U Example 5.2 

Find a signal /(f) that is bandlimited to B Hz, and whose samples are 

/( 0) = 1 and }(±T) = f(±2T) = /(±3T) = • • ■ = 0 

where the sampling interval T is the Nyquist interval for /(f); that is, T = 1/2JS. 

We use the interpolation formula (5.10b) to construct /(f) from its samples. Since 
all but one of the Nyquist samples are zero, only one term (corresponding to fc = 0) in the 
summation on the right-hand side of Eq. (5.10b) survives. Thus 

/(f) = sine (2ir Bt) 

This signal is illustrated in Fig. 5.4b. Observe that this is the only signal that has a 
bandwidth B Hz and the sample values /( 0) = 1 and f{nT) = 0 (n ^ 0). No other signal 
satisfies these conditions. B 

5.1-2 Practical Difficulties in Signal Reconstruction 

If a signal is sampled at the Nyquist rate J- s — 2 B Hz, the spectrum F (ui) con- 
sists of repetitions of F(w) without any gap between successive cycles, as depicted 
in Fig. 5.5a. To recover /(t) from /(f), we need to pass the sampled signal J(t) 
through an ideal lowpass filter, shown dotted in Fig. 5.5a. As seen in Sec. 4.5, such 
a filter is unrealizable; it can be closely approximated only with infinite time delay 
in the response. In other words, we can recover the signal /(f) from its samples 
with infinite time delay. A practical solution to this problem is to sample the signal 
at a rate higher than the Nyquist rate (F s > 2 B or u s > 4 nB). The result is 
^( w )> consisting of repetitions of F(w) with a finite band gap between successive 
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(a) 


(b) 


Fig. 5.5 Spectra of a signal sampled at (a) the Nyquist rate (b) above the Nyquist rate. 

cycles, as illustrated in Fig. 5.5b. We can now recover F(w) from F(u) using a 
lowpass filter with a gradual cutoff characteristic, shown dotted in Fig. 5.5b. But 
even in this case, the filter gain must be zero beyond the first cycle of F(w) (see 
Fig. 5.5b). According to the Paley-Wiener criterion, it is impossible to realize even 
this filter. The only advantage in this case is that the required filter can be closely 
approximated with a smaller time delay. This fact indicates that it is impossible 
in practice to recover a bandlimited signal / (l) exactly from its samples, even if 
the sampling rate is higher than the Nyquist rate. However, as the sampling rate 
increases, the recovered signal approaches the desired signal more closely. 



Fig. 5.6 Aliasing effect. 


The Treachery of Aliasing 

There is another fundamental practical difficulty in reconstructing a signal from 
its samples. The sampling theorem was proved on the assumption that the signal 
/(t) is bandlimited. All practical signals are timelimited; that is, they are of 
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finite duration or width. We can demonstrate (see Prob. 5.1-10) that a signal cannot 
be timelimited and bandlimited simultaneously. If a signal is timelimited, it cannot 
be bandlimited and vice versa (but it can be simultaneously nontimelimited and 
nonbandlimited) . Clearly, all practical signals, which are necessarily timelimited, 
are nonbandlimited; they have infinite bandwidth, and the. spectrum F(u) consists 
of overlapping cycles of F(o>) repeating every Hz (the sampling frequency), as 
illustrated in Fig. 5.6. Because of infinite bandwidth in this case, the spectral overlap 
is a constant feature, regardless of the sampling rate. Because of the overlapping 
tails, F(ai) no longer has complete information about F(u), and it is no longer 
possible, even theoretically, to recover fit ) from the sampled signal /(t). If the 
sampled signal is passed through an ideal lowpass filter, the output is not F(w) but 
a version of F(w) distorted as a result of two separate causes: 

1. The loss of the tail of F(w) beyond |.F| > T s f2 Hz; 

2. The reappearance of this tail inverted or folded onto the spectrum. Note that 
the spectra cross at frequency ;F s /2 = 1/2 T Hz. This frequency is called the 
folding frequency. The spectrum, therefore, folds onto itself at the folding 
frequency. For instance, a component of frequency + T x shows up as or 
“impersonates” a component of lower frequency - T x in the reconstructed 
signal. Thus, the components of frequencies above JF S / 2 reappear as com- 
ponents of frequencies below .F.,/2. This tail inversion, known as spectral 
folding or aliasing, is shown shaded in Fig. 5.6. In this process of aliasing, 
not only are we losing all the components of frequencies above .F s /2 Hz, but 
these very components reappear (aliased) as lower frequency components. This 
reappearance destroys the integrity of the lower frequency components also, as 
depicted in Fig. 5.6. 

Aliasing problem is analogous to that of an army with a platoon that has secretly 
defected to the enemy side. The platoon is, however, ostensibly loyal to the army. 
The army is in double jeopardy. First, the army has lost this platoon as a fighting 
force. In addition, during actual fighting, the army will have to contend with the 
sabotage by the defectors, and will have to find another loyal platoon to neutralize 
the defectors. Thus, the army has lost two platoons in nonproductive activity. 

A Solution: The Antialiasing Filter 

If you were the commander of the betrayed army, the solution to the problem 
would be obvious. As soon as the commander gets wind of the defection, he would 
incapacitate, by whatever means, the defecting platoon before the fighting begins. 
This way he loses only one (the defecting) platoon. This is a partial solution to the 
double jeopardy of betrayal, a solution that partly rectifies the problem and reduces 
the losses to half. 

We follow exactly the same procedure. The potential defectors are all the fre- 
quency components beyond ^ Hz. We should eliminate (suppress) these 

components from f{t) before sampling f{t). This way we lose only the components 
beyond the folding frequency Hz; these components now cannot reappear to cor- 
rupt the components with frequencies below the folding frequency. This suppression 
of higher frequencies can be accomplished by an ideal lowpass filter of bandwidth 
T s f2 Hz. This filter is called the antialiasing filter. Note that the antialiasing 
operation must be performed before the signal is sampled. 
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Fig. 5.7 Effect of practical sampling. 


The antialiasing filter, being an ideal filter, is unrealizable. In practice, we use 
a steep cutoff filter, which leaves a sharply attenuated residual spectrum beyond 
the folding frequency T s j 2 . 

Practical Sampling 

In proving the sampling theorem, we assumed ideal samples obtained by multi- 
plying a signal /(f) by an impulse train which is physically nonexistent. In practice, 
we multiply a signal /(f) by a train of pulses of finite width, depicted in Fig. 5.7b. 
The sampled signal is illustrated in Fig. 5.7c. We wonder whether it is possible to 
recover or reconstruct /(f) from the sampled signal /(f) in Fig. 5.7c. Surprisingly, 
the answer is affirmative, provided that the sampling rate is not below the Nyquist 
rate. The signal /(f) can be recovered by lowpass filtering /(f) as if it were sampled 
by impulse train. 

The plausibility of this result becomes apparent when we consider the fact that 
reconstruction of /(f) requires the knowledge of the Nyquist sample values. This 
information is available or built in the sampled signal /(f) in Fig. 5.7c because the 
fcth sampled pulse strength is f(kT). To prove the result analytically, we observe 
that the sampling pulse train pp(t) depicted in Fig. 5.7b, being a periodic signal, 
can be expressed as a trigonometric Fourier series 

^2, 2tt 

p T (t) = Cq + 2^C n cos(nbj s t + 9 n ) w 3 = — 
n— 1 
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Fig. 5.8 An example of practical sampling. 


and 

OO 

/(*) = f{t)pr(t) = f(t) Co + C n cos ( nuj s t + 6 n ) 

n= 1 
oo 

= C 0 /(f) + ^2 C n /(f) cos (nui,t + 9 n ) (5.11) 

71=1 

The sampled signal /(f) consists of Co/(f), Cj/ff) cos ( ui s t + f?i), C 2 /(t ) cos (2u> s f + 
62 ), — Note that the first term Co/(t) is the desired signal and all the other terms 
are modulated signals with spectra centered at ±u s , ±2w s , ±3t j 3 , . . ., as illustrated 
in Fig. 5.7e. Clearly the signal /(f) can be recovered by lowpass filtering of /(f), 
provided that <v s > 4?rS (or T s > 25). 

H Example 5.3 

To demonstrate practical sampling, consider a signal /(f) = sinc 2 (57rf) sampled by a 
rectangular pulse sequence pr(t) illustrated in Fig. 5.8c. The period of ptU) is 0.1 second, 
so that the fundamental frequency (which is the sampling frequency) is 10 Hz. Hence, 
u a = 207T. The Fourier series for pr(t) can be expressed as 

OO 

pr(f) = Co + ^2 C n cos nu> s t 

n= 1 
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Co = -, 
Consequently 




r _V2 
Ca ~ to’ 


/(t) = /(£)pt( 0 = i/(t) H f(t) cos 207 t£ + — f(t) cos 407r£ 4- — — f{t) cos 607r£ H 

4 7T 7T oTT 

and 

F(u>) = ;F(u) + ~^=[F(u - 20tt) + F(iu + 20ir)] + i[F(w - 40 tt) + F(u> + 40tt)] 

4 7tv2 2tt 

4 ^-r=[F(u> - 60ir) 4- F(u) + 60jr)] 4- ■ ■ ■ 

3»rv2 

In the present case F(ui) = 0.2A(j^jr). The spectrum F(u) is depicted in Fig. 5.8e. 
Observe that the spectrum consists of F(u) repeating periodically at the interval of 20 jt 
rad/s (10 Hz). Hence, there is no overlap between cycles, and F(w) can be recovered by 
using an ideal lowpass filter of bandwidth 5 Hz. An ideal lowpass filter of unit gain (and 
bandwidth 5 Hz) will allow the first term on the right-side of the above equation to pass 
fully and suppress all the other terms. Hence, the output y(t) is 

y(t) = \f(t) U 
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5.1-3 Some Applications of the Sampling Theorem 

The sampling theorem is very important in signal analysis, processing, and 
transmission because it allows us to replace a continuous-time signal by a discrete 
sequence of numbers. Processing a continuous-time signal is therefore equivalent 
to processing a discrete sequence of numbers. Such processing leads us directly 
into the area of digital filtering. In the field of communication, the transmission 
of a continuous-time message reduces to the transmission of a sequence of numbers 
using pulse trains. The continuous-time signal /(f) is sampled, and sample values 
are used to modify certain parameters of a periodic pulse train. We may vary the 
amplitudes (Fig. 5.9b), widths (Fig. 5.9c), or positions (Fig. 5.9d) of the pulses in 
proportion to the sample values of the signal /(t). Accordingly, we have pulse- 
amplitude modulation (PAM), pulse- width modulation (PWM), or pulse 
position modulation (PPM). The most important form of pulse modulation today 
is pulse code modulation (PCM), discussed below. In all these cases, instead of 
transmitting /(t), we transmit the corresponding pulse-modulated signal. At the 
receiver, we read the information of the pulse-modulated signal and reconstruct the 
analog signal f(t). 



Fig. 5.10 Time-division multiplexing of two signals. 


One advantage of using pulse modulation is that it permits the simultaneous 
transmission of several signals on a time-sharing basis (time-division multiplex- 
ing, or TDM). Because a pulse-modulated signal occupies only a part of the chan- 
nel time, we can transmit several pulse-modulated signals on the same channel by 
inter- 
weaving them. Figure 5.10 shows the TDM of two PAM signals. In this manner, 
we can multiplex several signals on the same channel by reducing pulse widths. 

Another method of transmitting several baseband signals simultaneously is 
frequency- division multiplexing (FDM), discussed in Sec. 4.8-4. In FDM various 
signals are multiplexed by sharing the channel bandwidth. The spectrum of each 
message is shifted to a specific band not occupied by any other signal. The informa- 
tion of various signals is located in nonoverlapping frequency bands of the channel 
(Fig. 4.45). In a way, TDM and FDM are the duals of each other. 
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Pulse Code Modulation (PCM) 

PCM is the most useful and widely used of all the pulse modulations mentioned. 
Basically, PCM is a method of converting an analog signal into a digital signal (A/D 
conversion). An analog signal is characterized by the fact that its amplitude can 
take on any value over a continuous range. Hence, analog signal can take on an 
infinite number of values. In contrast, a digital signal amplitude can take on only 
a finite number of values. An analog signal can be converted into a digital signal 
by means of sampling and quantizing (rounding off). Sampling an analog signal 
alone will not yield a digital signal because a sampled analog signal can still take on 
any value in a continuous range. It is digitized by rounding off its value to one of 
the closest permissible numbers (or quantized levels), as illustrated in Fig. 5.11a. 
The amplitudes of the analog signal f(t) lie in the range (— V, V). This range is 
partitioned into L subintervals, each of magnitude An = 2 V/L. Next, each sample 
amplitude is approximated by the midpoint value of the subinterval in which the 
sample falls (see Fig. 5.11a for L = 16). It is clear that each sample is approximated 
to one of the L numbers. Thus, the signal is digitized with quantized samples taking 
on any one of the L values. Such a signal is known as an I-ary digital signal. 

From a practical viewpoint, a binary digital signal (a signal that can take on 
only two values) is very desirable because of its simplicity, economy, and ease of 
engineering. We can convert an T-ary signal into a binary signal by using pulse 
coding. Figure 5.11b shows such a code for the case of L = 16. This code, formed 
by binary representation of the 16 decimal digits from 0 to 15, is known as the 
natural binary code (NBC). Other possible ways of assigning a binary code 
exist. Each of the 16 levels to be transmitted is assigned one binary code of four 
digits. Thus, each sample in this example is encoded by four binary digits. To 
transmit this binary data, we need to assign a distinct pulse shape to each of the 
two binary states. One possible way is to assign a negative pulse to a binary 0 and 
a positive pulse to a binary 1 so that each sample is now transmitted by a group of 
four binary pulses (pulse code), as depicted in Fig. 5.11b. The resulting signal is a 
binary PCM signal. The analog signal /(f) is now converted to a (binary) digital 
signal. A binary digit is called bit for convenience. This contraction of binary digit 
by bit has become an industry standard abbreviation. 

The audio signal bandwidth is about 15 kHz, but subjective tests show that 
signal articulation (intelligibility) is not affected if all the components above 3400 Hz 
are suppressed. 3 ) Since the objective in telephone communication is intelligibility 
rather than high fidelity, the components above 3400 Hz are eliminated by a lowpass 
filter. The resulting signal is then sampled at a rate of 8000 samples per second (8 
kHz). This rate is intentionally kept higher than the Nyquist sampling rate of 6.8 
kHz to avoid unrealizable filters required for signal reconstruction. Each sample is 
finally quantized into 256 levels (L = 256), which requires a group of eight binary 
pulses to encode each sample (2 s = 256). Thus, a digitized telephone signal consists 
of 8 x 8000 = 64000 or 64 kbits/s data, requiring 64,000 binary pulses per second 
for its transmission. 

The compact disc (CD) is a recent application of PCM. This is a high-fidelity 
situation requiring the audio signal bandwidth of 15 kHz. Although the Nyquist 
sampling rate is only 30 kHz, an actual sampling rate of 44.1 kHz is used for the 
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(Components below 300 Hz may also be suppressed without affecting the articulation. 
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reason mentioned earlier. The signal is quantized into a rather large number of 
levels (L = 65, 536) to reduce quantizing error. The binary-coded samples are now 
recorded on the CD. 

Advantages of Digital Signals 

Some of the advantages of digital signals over analog signals are listed below: 

X. Transmission of digital signals is more rugged than that of analog signals be- 
cause digital signals can withstand channel noise and distortion much better 
as long as the noise and the distortion are within limits. The digital (binary) 
message in Fig. 5.12a is distorted by the channel, as illustrated in Fig. 5.12b. 
Yet if the distortion remains within a limit, we can recover the data without 
error because we need only to make a simple binary decision as to whether the 
received pulse is positive or negative. Figure 5.12c shows the same data with 
channel distortion and noise. Here again the data can be recovered correctly as 
long as the distortion and the noise are within limits. Such is not the case with 
analog messages. Any distortion or noise, no matter how small, will distort the 
received signal. 


A/2 




Fig. 5.12 Digital signal: (a) transmitted (b) received distorted signal (without noise) 
(c) received distorted signal (with noise) (d) regenerated signal at the receiver. 


2. The greatest advantage of digital signal transmission over analog transmission, 
however, is the viability of regenerative repeaters in the former. In an analog 
transmission system, a message signal, as it travels along the channel (trans- 
mission path), grows progressively weaker, whereas the channel noise and the 
signal distortion, being cumulative, become progressively stronger. Ultimately 
the signal, overwhelmed by noise and distortion, is mutilated. Amplification is 
of little help because it enhances the signal and the noise in the same proportion. 
Consequently, the distance over which an analog message can be transmitted 
is limited by the transmitted power. If a transmission path is long enough, the 
channel distortion and noise will accumulate sufficiently to overwhelm even a 
digital signal. The trick is to set up repeater stations along the transmission 
path at distances short enough to be able to detect signal pulses before the noise 
and distortion have a chance to accumulate sufficiently. At each repeater sta- 
tion the pulses are detected, and new, clean pulses are transmitted to the next 
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repeater station, which, in turn, duplicates the same process. If the noise and 
distortion remain within limits (which is possible because of the closely spaced 
repeaters), pulses can be detected correctly.) This way the digital messages 
can be transmitted over longer distances with greater reliability. In contrast, 
analog messages cannot be cleaned up periodically, and the transmission is 
therefore less reliable. The most significant error in PCM comes from quantiz- 
ing. This error can be reduced as much as desired by increasing the number of 
quantizing levels, the price of which is paid in an increased bandwidth of the 
transmission medium (channel). 

3. Digital hardware implementation is flexible and permits the use of micropro- 
cessors, miniprocessors, digital switching, and large-scale integrated circuits. 

4. Digital signals can be coded to yield extremely low error rates and high fidelity, 
as well as privacy. Also, more sophisticated algorithms can be used to process 
digital signals. 

5. It is easier and more efficient to multiplex several digital signals. 

6. Digital signal storage is relatively easy and inexpensive. It also has the ability 
to search and select information from distant electronic storehouses. 

7. Reproduction with digital messages is extremely reliable without deterioration. 
Analog messages such as photocopies and films, for example, lose quality at 
each successive stage of reproduction, and have to be transported physically 
from one distant place to another, often at relatively high cost. 

8. The cost of digital hardware continues to halve every two or three years, while 
performance or capacity doubles over the same time period. And there is no 
end in sight yet to this breathtaking and relentless exponential progress in 
digital technology. In recent years we have seen the compact disc — a digital 
device — bury the analog long-playing record; newspapers transmit photographs 
in scanned digital form; and more recently the shift in the United States toward 
a digital standard for high-definition television as opposed to the analog stan- 
dard embraced by Japan and Europe. In contrast, analog technologies such as 
paper, video, sound, and film do not decline rapidly in cost. If anything, they 
become more expensive with time. For these and other reasons, it is only a 
matter of time before cost/performance curves cross, and digital technologies 
come to dominate in any given area of communication or storage technologies. 

As mentioned earlier, digital signals come from a variety of sources. Some 
sources such as computers are inherently digital. Some sources are analog, but are 
converted into digital form by a variety of techniques such as PCM modulation. 

A Exercise E5.2 

American Standard Code for Information Interchange (ASCII) has 128 characters which are 
binary coded. A certain computer generates 100,000 characters/s. Show that 

(a) 7 bits (binary digits) are required to encode each character. 

(b) 700,000 bits/s are required to transmit the computer output. V 

A Historical Note 

Gottfried Wilhelm Leibnitz (1646-1716) was the first mathematician to work 
out systematically the binary representation (using l’s and 0’s) for any number. 

fThe error in pulse detection can be made negligible. 
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He felt a spiritual significance in this discovery, reasoning that 1 representing unity 
was clearly a symbol for God, while 0 represented the nothingness. Therefore, if all 
numbers can be represented merely by the use of 1 and 0, surely this is the same 
as saying that God created the universe out of nothing! 

5.1-4 Dual of the Time-Sampling: The Spectral Sampling Theorem 

As in other cases, the sampling theorem has its dual. In Sec. 5.1, we discussed 
the time-sampling theorem where we showed that a signal bandlimited to B Hz can 
be* reconstructed from the signal samples taken at a rate of F s > 2 B samples/s. 
Note that the signal spectrum exists over the frequency range -B to B Hz. There- 
fore, 2 B is the spectral width (not the bandwidth, which is B) of the signal. This 
fact means that a signal f(t) can be reconstructed from samples taken at a rate F s 
greater than the spectral width (in Hz) of the signal. 

The dual of the time-sampling theorem is the frequency-sampling theorem. 
This theorem applies to timelimited signals, which are duals of bandlimited signals. 
We now prove that the spectrum F(u>) of a signal timelimited to r seconds can be 
reconstructed from the samples of F(u) taken at a rate R > r (the signal width) 
samples per Hertz. 

Figure 5.13a shows a signal /(t) that is timelimited to r seconds along with its 
Fourier transform F(u>). Although F(u>) is complex in general, it is adequate for 
our line of reasoning to show F(u) as a real function. 




We now construct /r 0 (t) , a periodic signal formed by repeating f(t) every T 0 
seconds (To > r), as depicted in Fig. 5.13b. This periodic signal can be expressed 
by the exponential Fourier series 


OO 

/r„(t)= £ D " e, ™ at 

n—~ oo 


2ir 
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D n = ^r P f(t)e -*“->* dt=~ I" /(t)e-*""‘ dt 

do Jo To J 0 


From Eq. (5.12) it follows that 


D n = —F(nui 0 ) 
To 


This result indicates that the coefficients of the Fourier series for fr 0 (t) are (1/To) 
times the sample values of the spectrum F(u) taken at intervals of wq. This means 
that the spectrum of the periodic signal /r 0 (<) is the sampled spectrum F(ui), as 
illustrated in Fig. 5.13b. Now as long as r < To, the successive cycles of f{t) 
appearing in /r 0 (f) do not overlap, so that f(t) can be recovered from /r o (0- Such 
recovery implies indirectly that F(uj) can be reconstructed from its samples. These 
samples are separated by the fundamental frequency Fq = 1/To Hz of the periodic 
signal /t 0 (<)- The condition for recovery is that To > r; that isf 

Fq < — Hz 

Therefore, to be able to reconstruct the spectrum F(ui) from the samples of F(«), 
the samples should be taken at frequency intervals not greater than Fo = 1/r Hz. 
If R is the sampling rate (samples/Hz), then 

R = — > t samples/Hz (5.13) 

Fo 

Spectral Interpolation 


The spectrum F(w) of a signal f(t) timelimited to r seconds can be recon- 
structed from the samples of F(u). For this case, using the dual of the approach 
employed to derive the signal interpolation formula in Eq. (5.10), we obtain the 
spectral interpolation formula 

F(tu) = 'y^F(nuip) sine - nrr) uj 0 — — (5.14) 

n " 

U Example 5.4 

The spectrum F(w) of a unit duration signal f(t) is sampled at the intervals of 1 Hz 
or 27 t rad/s (the Nyquist rate). The samples are: 


F(0) = 1 and F(±27rn) = 0 (n = 1, 2, 3, . . .) 

We use the interpolation formula (5.14) to construct F(u) from its samples. Since all 
but one of the Nyquist samples are zero, only one term (corresponding to n = 0) in the 
summation on the right-hand side of Eq. (5.14) survives. Thus, with F(0) = 1 and r = 1, 
we obtain 


F(w) = sine ^ (5.15) 

For a signal of unit duration this is the only spectrum with the sample values F(0) = 1 
and F(2irn) = 0(n^0). No other spectrum satisfies these conditions. M 


fThis result assumes that f(t) does not have impulses at t = 0 or r. If impulses do occur, then 
Tq < 1/r. 
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5.2 Numerical Computation of the Fourier Transform: 

The Discrete Fourier Transform (DFT) 

Numerical computation of the Fourier transform of /(t) requires sample values 
of f(t) because a digital computer can work only with discrete data (sequence of 
numbers). Moreover, a computer can compute F{ui) only at some discrete values 
of u [samples of F(u>)]. We therefore need to relate the samples of F(u) to samples 
of f(t). This task can be accomplished by using the results of the two sampling 
theorems developed in Sec. 5.1. 

We begin with a timelimited signal f(t) (Fig. 5.14a) and its spectrum F(u>) (Fig. 
5.14b). Since / (f) is timelimited, F(u) is nonbandlimited. For convenience, we shall 
show all spectra as functions of the frequency variable T (in Hertz) rather than u. 
According to the sampling theorem, the spectrum F(u>) of the sampled signal f(t) 
consists of F(u>) repeating every T, Hz where T s = 1/T. This is depicted in Figs. 
5.14c and 5.14d.f In the next step, the sampled signal in Fig. 5.14c is repeated 
periodically every To seconds, as illustrated in Fig. 5.14e. According to the spectral 
sampling theorem, such an operation results in sampling the spectrum at a rate 
of To samples per Hz. This sampling rate means that the samples are spaced at 
T 0 — 1 /T 0 Hz, as depicted in Fig. 5.14f. 

The above discussion shows that, when a signal }{t) is sampled and then pe- 
riodically repeated, the corresponding spectrum is also sampled and periodically 
repeated. Our goal is to relate the samples of f(t) to the samples of F(w). 

Number of Samples 

One interesting observation in Figs. 5.14e and 5.14f is that No, the number of 
samples of the signal in Fig. 5.14e in one period To is identical to Nq, the number 
of samples of the spectrum in Fig. 5.14f in one period T„. The reason is 


o 

II 

and 

•-X 

O 

II 

(5.16a) 


and 

II 

^1- 

(5.16b) 

N 0 = 

II 


(5.16c) 


Aliasing and Leakage in Numerical Computation 

Figure 5.14f shows the presence of aliasing in the samples of the spectrum 
F(u>). This aliasing error can be reduced as much as desired by increasing the 
sampling frequency T s (decreasing the sampling interval T = y-). The aliasing 
can never be eliminated for timelimited /(<), however, because its spectrum F(u) is 
nonbandlimited. Had we started out with a signal having a bandlimited spectrum 
F(u), there would be no aliasing in the spectrum in Fig. 5.14f. Unfortunately such 


fThere is a multiplying constant 1/T for the spectrum in Fig. 5.14d [see Eq. (5.4)], but this is 
irrelevant to our discussion here. 
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a signal is nontimelimited and its repetition (in Fig. 5.14e) would result in signal 
overlapping (aliasing in the time domain). In this case we shall have to contend 
with errors in signal samples. In other words, in computing the direct or inverse 
Fourier transform numerically, we can reduce the error as much as we wish, but the 
error can never be eliminated. This fact is true of numerical computation of direct 
and inverse Fourier transforms, regardless of the method used. For example, if we 
determine the Fourier transform by direct integration numerically, using Eq. (4.8a), 
there will be an error because the interval of integration At can never be made 
zero. Similar remarks apply to numerical computation of the inverse transform. 
Therefore, we should always keep in mind the nature of this error in our results. 
In our discussion (Fig. 5.14), we assumed f(t) to be a timelimited signal. If f(t) 
is not timelimited, we would need to timelimit it because numerical computations 
can work only with finite data. Further, this data truncation causes error because 
of spectral spreading (smearing) and leakage, as discussed in Sec. 4.9. The leakage 
also causes aliasing. Leakage can be reduced by using a tapered window for signal 
truncation. But this choice increases spectral spreading or smearing. The spectral 
spreading can be reduced by increasing the window width (i.e. more data), which 
increases T 0 , and reduces Fq (increases spectral or frequency resolution). 

Picket Fence Effect 

The numerical computation method yields only the uniform sample values of 
F( u) [or f{t)). Using this method is like viewing a signal and its spectrum through a 
“picket-fence.” The major peaks of F(w) [or /(t)] could lie between two samples and 
may remain hidden, a situation giving a false picture of the reality. Such misleading 
results can be avoided by using a sufficiently large J V 0 , the number of samples, which 
increases resolution. We can also use the spectral interpolation formula [Eq. (5.14)J 
to determine the values of F(w) between samples. 

Derivation of the Discrete Fourier transform (DFT) 

If f(kT) and F(ru o) are the kth and rth samples of f{t) and F(u>), respectively, 
then we define new variables fk and F r as 



fk = Tf(kT) 



- 

(5.17a) 

and 

F r = F(ru 0 ) 

(5.17b) 

where 

o ^ 27r 

uo = 2tt> 0 = — 

J- 0 

(5.17c) 


We shall now show that fk and F r are related by the following equations:) 


fin Eqs. (5.18a) and (5.18b), the summation is performed from 0 to No — 1. It is shown in Eq. 
(10.12) that the summation may be performed over any successive No values of k or r. 


5.2 Numerical Computation of the Fourier Transform: The DFT 


341 


JVo-l 

F r = Y fk e ~ 3rn ° k (5.18a) ■ 

k= 0 

1 N °~ l o_ 

h = jrT F r e^° k fi 0 = w 0 T = £■ (5.18b) 

N ° T^o N ° 

These equations define the direct and the inverse discrete Fourier transforms 
(DFT), with F r the direct discrete Fourier transform (DFT) of /*,, and fk the 
inverse discrete Fourier transform (IDFT) of F r . The notation 

fk ’ ’ F r 

is also used to indicate that fk and F r are a DFT pair. Remember that fk is To/ No 
times the fcth sample of f(t) and F r is the rth sample of F(u>). Knowing the sample 
values of f(t), we can compute the sample values of F(u >) — and vice versa — using 
the DFT. Note, however, that fk is a function of it (fe = 0,1,2,..., JVo — 1) rather 
than of t and that F r is a function of r (r = 0, 1, 2, . . . , No — 1) rather than of 
ui. Moreover, both fk and F r are periodic sequences of period JVo (Figs. 5.14e and 
5.14f). Such sequences are called JVo-periodic sequences. The proof of the DFT 
relationships in Eqs._(5.18) follows directly from the results of the sampling theorem. 
The sampled signal f(t) (Fig. 5.14c) can be expressed as 

N 0 - 1 

/(<) = Y f ( k7 "> s - kT ) ( 5 l9 ) 

k= 0 

Since 6 (t - kT) <=> e~i kuT , the Fourier transform of Eq. (5.19) yields 

No — l 

F{u) = Y f(kT)e~ ikuT (5.20) 

k-0 

But from Fig. 5.1e [or Eq. (5.4)], it is clear that over the interval |w| < F(u ), 
the Fourier transform of f(t) is assuming negligible aliasing. Hence 

_ JVo— 1 

F(w) = TF(w) = T Y f{kT)e~i kuT \u\ < ^ 

. k = 0 1 

and 

Wo-l 

F r = F(nv 0 ) = T Y f(kT)e- jkr “° T (5.21) 

fc— o 

If we let w 0 T = D 0 , then from Eqs. (5.16a) and (5.16b) 

2tt 

D 0 = wo T = 2ttF 0 T = — (5.22) 

No 


Also, from Eq. (5.17a), 


Tf(kT) = f k 
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Therefore, Eq. (5.21) becomes 

N»-i 

F r = £ / fc e-^ rn » fc fi 0 = F (5.23) 

k = 0 0 

The inverse transform relationship (5.18b) could be derived by using a similar 
procedure with the roles of f and w reversed, but here we shall use a more direct 
proof. To prove the inverse relation in Eq. (5.18b), we multiply both sides of Eq. 
(5.23) by e> mn ° r and sum over r as 

No — 1 No— 1 [No-1 

F r e jmn ° r = f k e~ jrn ° k 

r —0 r = 0 . fc =0 

By interchanging the order of summation on the right hand side 

IVo-l 

y" gHm-k) n 0 r 
r =0 

Appendix 5.1 shows that the inner sum on the right hand side is zero for k yt m, 
and that the sum is No when k = m. Therefore the outer sum will have only one 
nonzero term when k = m, and it is Nofk = Nof m . Therefore 





, No-l 


n° = ^ 

No 


Because F r is IVo-periodic, we need to determine the values of F r over any one 
period. It is customary to determine F r over the range (0, No - 1) rather than over 
the range (-^, ^ - 1)4 


Choice of T, To , and JV 0 

In DFT computation, we first need to select suitable values for No,T , and To. 
For this purpose we should first decide on B, the essential bandwidth (in hertz) of 
the signal. The sampling frequency T a must be at least 2 B\ that is, 

Y~B (5.25a.) 

Moreover, the sampling interval T = y- [Eq. (5.16b)], and 

T<~ (5.25b) 

Once we pick B , we can choose T according to Eq. (5.25b)). Also, 

= y 0 (526) 

where T 0 is the frequency resolution [separation between samples of F(u>)]. 
Hence, if T 0 is given, we can pick To according to Eq. (5.26). Knowing To and 
T, we determine N o from 


| The DFT relationships represent a transform in their own right, and they are exact. If, however, 
we identify fk and F r as the samples of a signal f(t) and of its Fourier transform F( u>), respectively, 
then the DFT relationships are approximations because of the aliasing and leakage effects. 
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T 

n o = y (5-27) 

Points of Discontinuity 

If /(t) has a jump discontinuity at a sampling point, the sample value should 
be taken as the average of the values on the two sides of the discontinuity because 
the Fourier representation at a point of discontinuity converges to the average value. 

Zero Padding 

Recall that observing F r is like observing the spectrum F(ui) through a “picket- 
fence.” If the frequency sampling interval T 0 is not sufficiently small, we could miss 
out on some significant details and obtain a misleading picture. To obtain a higher 
number of samples, we need to reduce T 0 . Because F 0 = 1/T 0 , a higher n um ber 
of samples requires us to increase the value of To, the period of repetition for /(£). 
This option increases N 0 , the number of samples of /(£), by adding dummy samples 
with a value of 0. This addition of dummy samples is known as zero padding. 
Thus, zero padding increases the number of samples and may help in getting a 
better idea of the spectrum F(u) from its samples F r . 

Zero Padding Does Not Improve Accuracy or Resolution 

One point should be understood clearly: that zero padding merely gives us more 
samples without improving the accuracy of those sample values. Zero padding will 
be useful only if the sampling interval T is sufficiently small so that the aliasing error 
is negligible. If there is a good deal of aliasing to begin with, zero padding will merely 
give us more samples of the garbage. It can never improve accuracy or frequency 
resolution in a true sense. The accuracy can be increased only by reducing aliasing, 
which requires reduction in the signal sampling interval T (T < 1/2B, where B is 
the effective bandwidth of the signal). 


H Example 5.5 

A signal f(t) has a duration of 2 ms and an essential bandwidth of 10 kHz. It is 
desirable to have a frequency resolution of 100 Hz in the DFT (F 0 = 100). Determine N 0 . 
The effective signal duration To is given by 




ms 


Since the signal duration is only 2 ms, we need zero padding over 8 ms. Also, B = 10, 000. 
Hence, F, = 2B = 20, 000 and T = l/F s = 50 /rs. Further, 



20, 000 

100 


= 200 


The fast Fourier transform (FFT) algorithm (discussed in Sec. 5.3) is used to compute 
DFT, where it proves convenient (although not necessary) to select No as a power of 2; 
that is, N 0 = 2" (n, integer). Let us choose N 0 = 256. Increasing N 0 from 200 to 256 can 
be used to reduce aliasing error (by reducing T), to improve resolution (by increasing T 0 ), 
or a combination of both. 


(i) Reducing aliasing error: We maintain the same To so that F„ = 100. Hence 


F, = N 0 Fo = 256 x 100 = 25600 and 


T = T = 39 /is 

6 
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Thus, increasing No from 200 to 256 permits us to reduce the sampling interval T from 
50 ps to 39 fis while maintaining the same frequency resolution (T„ = 100). 

(ii) Improving resolution: Here we maintain the same T = 50 ;;s. which yields 


To = N a T = 256(50 x 1(T 6 ) = 12.8 ms and T<, = = 78.125 Hz 

To 

Thus, increasing No from 200 to 256 can improve the frequency resolution from 100 to 
78.125 Hz while maintaining the same aliasing error (T = 50 [is). 

(iii) Combination of these two options 

We could choose T — 45 ps and To = 11.5 ms so that To = 86.96 Hz. B 

■ Example 5.6 

Use DFT to compute the Fourier transform of e~ 2t u(t). Plot the resulting Fourier 
spectra. 

We first determine T and To- The Fourier transform of e -2t u(f) is 1 /(/w + 2). This 
lowpass signal is not bandlimited. In Sec. 4.6, we used the energy criterion to compute the 
essential bandwidth of a signal. Here, we shall present a simpler, but workable alternative 
to the energy criterion. The essential bandwidth of a signal will be taken as that frequency 
where |T(w)| reduces to 1% of its peak value (see footnote on p. 276). In this case, the 
peak value occurs at w = 0, where |T(0)| = 0.5. Observe that 


Also, 1% of the peak value is 0.01 x 0.5 = 0.005. Hence, the essential bandwidth B is at 
u = 2-kB, where 

l*V)l “ = 0005 ^=™Hz 

and from Eq. (5.25b), 



Had we used 1% energy criterion to determine the essential bandwidth, following the 
procedure in Example 4.16, we would have obtained B — 20.26 Hz, which is somewhat 
smaller than the value just obtained by using 1% amplitude criterion. 

The second issue is to determine To- Because the signal is not timelimited, we have 


to truncate it at To such that /(To) <K 1. A reasonable choice would be To = 4 because 
/( 4) = e -8 = 0.000335 -C 1. The result is No = To/T = 254.6, which is not a power of 2. 
Hence, we choose To = 4, and T = 0.015625 = 1/64, yielding N 0 = 256, which is a power 


of 2. 


Note that there is a great deal of flexibility in determining T and To, depending on 
the accuracy desired and the computational capacity available. We could just as well have 
chosen T = 0.03125, yielding No = 128, although this choice would have given a slightly 


higher aliasing error. 

Because the signal has a jump discontinuity at t = 0, the first sample (at t = 0) is 0.5, 
the averages of the values on the two sides of the discontinuity. We compute F r (the DFT) 
from the samples of e~ 2t u{t ) according to Eq. (5.18a). Note that F r is the rth sample of 
F( w), and these samples are spaced at To = 1/To = 0.25 Hz. (wo = tr/2 rad/s.) 

Because TV is No-periodic, T r = T (r+2 56 ) so that T 256 = To. Hence, we need to 
plot F r over the range r = 0 to 255 (not 256). Moreover, because of this periodicity, 
F—r — T(_ r _|_ 256 ) , and the values of F r over the range r = -127 to —1 are identical to 
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those over the range r = 129 to 255. Thus, T_ 127 = T 129 , T_ 126 = T 130 , . . . T_ 1 = T 255 . 
In addition, because of the property of conjugate symmetry of the Fourier transform, 
T-r = FZ , it follows that T_ 1 = F * , T _ 2 = T 2 *, . . . , T_ 128 = T/ 2S . Thus, we need F r only 
over the range r = 0 to No/2 (128 in this case). 

Figure 5.15 shows the plots of |T r | and lF r and the exact magnitude and phase 
spectra (depicted by continuous curves) for comparison. Note the nearly perfect agreement 
between the two sets of spectra. We have depicted the plot of only the first 28 points rather 
than all the 128 point because it would have made the figure very crowded, resulting in 
loss of clarity. The points are at the intervals of 1/To = 1/4 Hz or wo = 1.5708 rad/s. The 
28 samples, therefore, exhibit the plots over the range w = 0 to w = 28(1.5708) as 44 rad/s 
or 7 Hz. 

In this example, we knew T(w) beforehand and hence could make intelligent choices 
for B (or the sampling frequency T,). In practice, we generally do not know T(w) be- 
forehand. In fact, that is the very thing we are trying to determine. In such a case, we 
must make an intelligent guess for B or TV from circumstantial evidence. We should then 
continue reducing the value of T and recomputing the transform until the result stabilizes 
within the desired number of significant digits. The MATLAB program, which implements 
the DFT using the FFT algorithm, is presented in Example C5.1. B 



0 10 20 30 40 w — 



Q Computer Example C5.1 

Use DFT (implemented by the FFT, the fast Fourier transform algorithm) to compute 
the Fourier transform of e' 2t u(t). 

T=0.015625;T0=4;N0=T0/T; 

t=0:T:T*(N0-l);t=t’; 

f=T*exp(-2*t); 
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f(l)=T*0.5; 

F=fft(f); 

[Fp,Fm]=cart2pol(real(F),imag(F)); 

k=0:N0-l; k=k’; 

w=2*pi*k/T0; 

subplot (211), plot (w(l: 128), Fm(l:128)) 

subplot (212) ,plot(w(l:128),Fp(l:128)) Q 

I Example 5.7 

Use DFT to compute the Fourier transform of 8rect (t). 

This gate function and its Fourier transform are illustrated in Fig. 5.16a and b. To 
determine the value of the sampling interval T, we must first decide on the essential 
bandwidth B. In Fig. 5.16b, we see that F(u) decays rather slowly with ui. Hence, 
the essential bandwidth B is rather large. For instance, at B — 15.5 Hz (97.39 rad/s), 
F(w) = -0.1643, which is about 2% of the peak at F(0). Hence, the essential bandwidth 
is well above 16 Hz if we use the 1% criterion for computing the essential bandwidth. 
However, we shall deliberately take B = 4 for two reasons: (1) to show the effect of 
aliasing and (2) the use of B > 4 will give enormous number of samples, which cannot 
be conveniently displayed on the book size page without losing sight of the essentials. 
Thus, we shall intentionally accept approximation in order to clarify the concepts of DFT 
graphically. 

The choice of B = 4 results in the sampling interval T — jg = Looking again 
at the spectrum in Fig. 5.16b, we see that the choice of the frequency resolution F„ = f 
Hz is reasonable. Such a choice gives us four samples in each lobe of F{ui). In this case 
To = y- = 4 seconds and No = ^ = 32. The duration of f(t) is only 1 second. We must 
repeat it every 4 seconds (To = 4), as depicted in Fig. 5.16c, and take samples every | 
second. This choice yields 32 samples (JVo = 32). Also, 

fk = Tf(kT) 

= g/(fcT) 

Since f{t) = 8rect(t), the values of fk are 1, 0, or 0.5 (at the points of discontinuity), as 
illustrated in Fig. 5.16c. In this figure, fk is depicted as a function of t as well as fc, for 
convenience. 

In the derivation of the DFT, we assumed that f(t) begins at t = 0 (Fig. 5.14a), 
and then took IVo samples over the interval (0, To). In the present case, however, f(t) 
begins at - 1 . This difficulty is easily resolved when we realize that the DFT obtained by 
this procedure is actually the DFT of fk repeating periodically every To seconds. Figure 
5.16c clearly indicates that repeating the segment of fk over the interval from -2 to 2 
seconds periodically is identical to repeating the segment of fk over the interval from 0 to 
4 seconds. Hence, the DFT of the samples taken from -2 to 2 seconds is the same as that 
of the samples taken from 0 to 4 seconds. Therefore, regardless of where /(t) starts, we 
can always take the samples of f{t) and its periodic extension over the interval from 0 to 
To. In the present example, the 32 sample values are 

( 1 0 < k < 3 and 29 < k < 31 

0 5 < k < 27 

0.5 fc = 4,28 

Observe that the last sample is at t — 31/8, not at 4, because the signal repetition starts 
at t = 4, and the sample at t = 4 is the same as the sample at t = 0. Now, No = 32 and 
flo = 2x/32 = 7r/16. Therefore [see Eq. (5.18a)] 
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31 

F r = Y,f ke ~ jT ^ k 

k= 0 

Values of F r are computed according to this equation and plotted in Fig. 5.16d. 

The samples F r are separated by T 0 = jr Hz. In this case To = 4, so the frequency 
resolution To is ~ Hz, as desired. The folding frequency = B = 4 Hz corresponds to 
r = ^ = 16. Because F r is Mo-periodic (Mo = 32), the values of F r for r = — 16 to 
n = — 1 are the same as those for r = 16 to n = 31. For instance, Fn = F-is, Fis = F_h, 
and so on. The DFT gives us the samples of the spectrum F(uj). 

For the sake of comparison, Fig. 5.16d also shows the shaded curve 8 sine (^), which 
is the Fourier transform of 8 rect (t). The values of F r computed from DFT equation show 
aliasing error, which is clearly seen by comparing the two superimposed plots. The error in 
Fa is just about 1.3%. However, the aliasing error increases rapidly with r. For instance, 
the error in F« is about 12%, and the error in Fio is 33%. The error in Fn is a whopping 
72%. The percent error increases rapidly near the folding frequency (r = 16) because f(t) 
has a jump discontinuity, which makes F(u>) decays slowly as l/<u. Hence, near the folding 
frequency, the inverted tail (due to abasing) is very nearly equal to F(u i) itself. Moreover, 
the final values are the difference between the exact and the folded values (which are very 
close to the exact values). Hence, the percent error near the folding frequency (r = 16 in 
this case) is very high, although the absolute error is very small. Clearly, for signals with 
jump discontinuities, the aliasing error near the folding frequency will always be high (in 
percentage terms), regardless of the choice of No- To ensure a negligible abasing error at 
any value r, we must make sure that No 3> r. This observation is valid for aU signals with 
jump discontinuities. I 

Q Computer Example C5.2 

Use DFT (implemented by the FFT algorithm) to compute the Fourier transform of 
8 rect (t). Plot the resulting Fourier spectra. 

The MATLAB program, which implements this DFT equation using the FFT algo- 
rithm, is given next. First we write a MATLAB program to generate 32 samples of /*, 
and then we compute the DFT. 

% (c52.m) 

N0=32;k=O:N0-l; 

f=[ones(l,4) 0.5 zeros(l,23) 0.5 ones(l,3)]; 

Fr=flFt(f); 

subplot (2, l,l),stem(k,f) 
xlabel(’k’);ylabel(’fk’)i 
subplot (2,1, 2),stem(k,Fr) 
xlabel(’r’);ylabel(’Fr’); Q 

5.2-1 Some Properties of DFT 

The discrete Fourier transform is basically the Fourier transform of a sampled 
signal repeated periodically. Hence, the properties derived earlier for the Fourier 
transform apply to the DFT as well. 
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1. Linearity 

If fk <=*■ F r and gk •<=*• G r , then 

0-iSk + a-29k 4=4- a-iF r + aiG r (5.28) 

The proof is trivial. 

2. Conjugate Symmetry 

' P N 0 -r = F v * (5.29) 

This follows from the conjugate symmetry property of the Fourier transform (F* = 
F_ r ) and the periodic property of DFT (F_ r = Fy 0 _ r ). Because of this property, 
we need compute only half the DFTs for real fk- The other half are the conjugates. 

3. Time Shifting (Circular Shifting) 

fk-n F r e-^ n ° n (5.30) 

Proof: Using Eq. (5.18b), we find the inverse DFT of F r e~ 3r(l ° n as 

, N a -\ No - 1 

__ V' F jrn 0 k _ ST F .jrflo(fc-n) _ i 

No ~ N ° h ~ 

4. Frequency Shifting 

f k e jk0 ° m <=4- F r _ m (5.31) 

Proof: This proof is identical to that of the time shifting property except that 
we start with Eq. (5.18a). 

5. Circular (also called periodic) Convolution 

fk ® gk <=> F r G r (5.32a) 

and 

fk9k 8 — '' r ®G r (5.32b) 

Mo 

For two Mo-periodic sequences fk and g k , the circular convolution is defined by 

N 0 -l No-l 

fk® 9k — ^ t fn9k—n — ^ ' 9nfk—n (5.33) 

n— 0 n=0 

To prove (5.32a), we find the DFT of circular convolution f k ®9k as 

No-l /N 0 -l \ No-l /No-l 

E E /»**-») e ~ irn ° k = E M E sk-ne- jrn ° k 

k-0 \ n=0 / nr=0 \ k=0 

No-l 

= E fn(G r e- 3rn ° n ) = F r Gr 

n= 0 
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Fig. 5.17 Graphical picture of circular convolution. 

Equation (5.32b) can be proved in the same way. 

For nonperiodic sequences, the convolution can be visualized in terms of two 
sequences, where one sequence is fixed and the other sequence is inverted and moved 
past the fixed sequence, one digit at a time. If the two sequences are Mo-periodic, 
the same configuration will repeat after Mo shifts of the sequence. Clearly the 
convolution @ gk becomes Mo-periodic (circular), and such convolution can be 
conveniently visualized as illustrated in Fig. 5.17 for the case of Mo = 4. The inner 
sequence /*. is clockwise and fixed. The outer sequence gk is inverted so that it 
becomes counterclockwise. This sequence is now rotated clockwise one unit at a 
time. We multiply the overlapping numbers and add. For example, the value of 
fk ®9k at k = 0 (Fig. 5.17) is 

fo9o + fi93 + hU2 + fz9\ 
and the value of /* ® gk at k = 1 is (Fig. 5.17) 

fo9l + fl9o + / 2 P 3 + fz92 

and so on. 

Applications of DFT 

The DFT is useful not only in the computation of direct and inverse Fourier 
transforms, but also in other applications such as convolution, correlation, and fil- 
tering. Use of the efficient FFT algorithm discussed in Sec. 5.3 makes it particularly 
appealing. 

Linear Convolution 

Let f(t) and g(t) be the two signals to be convolved. In general, these signals 
may have different time durations. To convolve them by using their samples, they 
must be sampled at the same rate (not below the Nyquist rate of either signal). 
Let f k (0 < k < Mi - 1) and gk (0 < k < M 2 - 1) be the corresponding discrete 
sequences representing these samples. Now, 

c(t) = f(t)*g(t) 

and if we define three sequences as fk = Tf(kT), gk = Tg(kT), and ct = Tc(kT), 
thenf 

Ck = fk* 9k 
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where we define the linear convolution sum of two discrete sequences fk and gk as 

OO 

fk* 9k = Y2 fn9k—n 
n=— 00 

Because of the width property of the convolution, ck exists for 0 < k < Mi +M 2 - 1. 
To be able to use the DFT technique of circular convolution, we must make sure 
that the circular convolution will yield the same result as the linear convolution. 
In other words, the resulting signal of the circular convolution must have the same 
length (Mi + N 2 - 1) as that of the signal resulting from linear convolution. This 
step can be accomplished by adding M 2 - 1 dummy samples of zero value to fk and 
Mi - 1 dummy samples of zero value to gk (zero padding). This procedure changes 
the length of both fk and gk to be Mi + M 2 — 1. The circular convolution now is 
identical to the linear convolution except that it repeats periodically with period 
Mi + M 2 — 1. The rigorous proof of this statement is provided in Sec. 10.6-3. 

We can use the DFT to find the convolution fk * gk in three steps, as follows: 

1. Find the DFTs F r and G r corresponding to suitably padded fk and gk- 

2. Multiply F r by G r . 

3. Find the IDFT of F r G r . This procedure of convolution, when implemented 
by the fast Fourier transform algorithm (discussed later), is known as the fast 
convolution. 

Filtering 

We generally think of filtering in terms of some hardware-oriented solution 
(namely, building a circuit with RLC components and operational amplifiers). How- 
ever, filtering also has a software-oriented solution [a computer algorithm that yields 
the filtered output y(t) for a given input /(t)]. This goal can be conveniently accom- 
plished by using the DFT. If f(t) is the signal to be filtered, then F r , the DFT of fk, 
is found. The spectrum F r is then shaped (filtered) as desired by multiplying F r by 
H r , where H r are the samples of the filter transfer function H(u) [Hr = M(r Wo )J. 
Finally, we take the IDFT of F r H r to obtain the filtered output yk [yk = Ty(kT)]. 
This procedure is demonstrated in the following example. 

I Example 5.8 

The signal / (t) in Fig. 5.18a is passed through an ideal lowpass filter of transfer 
function H(ui) depicted in Fig. 5.18b. Using DFT, find the filter output. 

We have already found the 32-point DFT of f(t) (see Fig. 5.16d). Next we multiply 
F r by H r - To find H r , we recall using T 0 = j in computing the 32-point DFT of f(t). 
Because F r is 32-periodic, H r must also be 32-periodic with samples separated by I Hz. 
This fact means that H r must be repeated every 8 Hz or 16 tt rad/s (see Fig. 5.18c). The 
resulting 32 samples of H r over (0 < a> < 16 tt) are as follows: 

{ 1 0 < r < 7 and 25 < r < 31 

0 9 < r < 23 

0.5 r = 8, 24 

We multiply F r with H r - The desired output signal samples yk are found by taking the 
inverse DFT of F r H r - The resulting output signal is illustrated in Fig. 5.18d. Table 5.1 
gives a printout of fk,F r , H r , Y r , and yk- H 


fWe can show that 4 Ck = lim-r— 0 fk* 9 k- Because T ^ 0 in practice, there will be some error in 
this equation. 
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Fig. 5.18 Filtering f(t ) through H{ui). 


Q Computer Example C5.3 

Solve Example 5.8 using MATLAB. 

The MATLAB program of Example C5.2, where we obtained the 32-point F r , should 
be saved as an m-file, e.g., ‘c52.m’. We can import F r in the MATLAB environment by 
the command ‘c52’. 

c52; 

NO=32;k=0:N0-l; 

H=[0nes(l,8) 0.5 zeros(l,15) 0.5 ones(l,7)]; 

Yr=H.*Fr; 
yk=ifft(Yr); 
stem(k,yk) Q 


5.3 The Fast Fourier Transform (FFT) 

The number of computations required in performing the DFT was dramatically 
reduced by an algorithm developed by Tukey and Cooley in 1965. 5 This algorithm, 
known as the Fast Fourier transform (FFT), reduces the number of computations 
from something of the order of Nq to No log No . To compute one sample F r from 
Eq. (5.18a), we require No complex multiplications and No - 1 complex additions. 
To compute No such values (F r for r = 0, 1, . . . , N 0 - 1), we require a total of Nq 


I 


5.3 The Fast Fourier Transform (FFT) 



complex multiplications and N 0 (N 0 - 1) complex additions. For a large N 0 , these 
computations can be prohibitively time-consuming, even for a high-speed computer. 

Although there are many variations of the original Tukey-Cooley algorithm, 
these can be grouped into two basic types: decimation-in-time and decimation- 
in-frequency. The algorithm is simplified if we choose No to be a power of 2, 
although such a choice is not essential. For convenience, we define 


so that 


W No = e“ w ‘ 

iV 0 -l 

Fr = £ fkWfc 

k = 0 


_ e -oa*/wb) = e -jn o 


0 < r < N 0 - 1 


(5.35a) 


x No-l 

A = E F ' w *o r 0 < k < No - 1 


(5.35b) 


The Decimation-in-Time Algorithm 

Here we divide the No-point data sequence /*, into two (^J-point sequences 
consisting of even- and odd-numbered samples respectively, as follows: 


/o, / 2, /4, • • ■ , f No-2, fl, fo, fs, ■ ■ ■ , f No — 1 


Then, from Eq. (5.35a), 


F r = E ^ W No r + E f^ W No 
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F rHnj2) 

Pig. 5.19 Butterfly. 

Also, since 

W,jp = W^ 0 (5.37) 

we have 

ihr-l !£-i 

Fr = Y, S2kW k N^+V/ r Na ^ f2k+lW l Nz 

k = 0 2 fc= 0 

= G r + W;) 0 H r 0 < r < No - 1 (5-38) 


where G r and H r are the (^)-point DFTs of the even- and odd-numbered se- 
quences, gk and h*,, respectively. Also, G r and H r , being the (^)-point DFTs, are 
( ^-periodic. Hence 


^ j-periuuic. xa 

dice 

G r+(^) =Gr 

H r+(^) = Hr 

(5.39) 

Moreover, 

K + 0 { ^ = wfo w k = ^ w k = ~ w k 

(5.40) 

From Eqs. (5.38) , 

(5.39), and (5.40), we obtain 



F r+{ ^ } = G r - W r No H r 

(5.41) 


This property can be used to reduce the number of computations. We can compute 
the first (^) points (0 < n < ^ - 1) of F r using Eq. (5.38) and compute the last 
^ points using Eq. (5.41) as 



F r = G r + Wp) 0 H r 

No „ 

0 < r < y - 1 

(5.42a) 

= Gr - W r No Hr 

X 2 > 

No 

0<r< y -l 

(5.42b) 


Thus, an Ao-point DFT can be computed by combining the two (^)-point DFTs, 
as in Eq. (5.42). These equations can be represented conveniently by the signal 
flow graph depicted in Fig. 5.19. This structure is known as a butterfly. Figure 
5.20a shows the implementation of Eqs. (5.39) for the case of No = 8. 

The next step is to compute the ( ^ )-point DFTs G r and H r . We repeat 
the same procedure by dividing gk and hk into two (-^“O-point sequences corre- 
sponding to the even- and odd-numbered samples. Then we continue this process 
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until we reach the one-point DFT. Figures 5.20a, 5.20b, and 5.20c show these steps 
for the case of JVo = 8. Figure 5.20c shows that the two-point DFTs require no 
multiplication. 

To count the number of computations required in the first step, assume that 
G r and H r are known. Equations (5.42) clearly show that to compute all the N 0 
points of the F r , -we require No complex additions and 4^ complex multiplications) 
(corresponding to H T ). 

In the second step, to compute the (4^)-point DFT G r from the (^)-point 
DFT, we require 4^ complex additions and 4j® complex multiplications. We require 
an equal number of computations for H r . Hence, in the second step, there are No 
complex additions and 4^ complex multiplications. The number of computations 
required remains the same in each step. Since a total of log 2 No steps is needed to 
arrive at a one-point DFT, we require, conservatively, a total of N a log 2 No complex 
additions and ) log 2 No complex multiplications, to compute the Nq- point DFT. 

The procedure for obtaining IDFT is identical to that used to obtain the DFT 
except that Wn 0 = instead of e-A^/JVo) (in addition to the multiplier 

1 /No). Another FFT algorithm, the decimation- in- frequency algorithm, is sim- 
ilar to the decimation-in-time algorithm. The only difference is that instead of 
dividing /*. into two sequences of even- and odd-numbered samples, we divide fk 
into two sequences formed by the first 4^ and the last 4^ digits, proceeding in the 
same way until a single-point DFT is reached in log 2 N 0 steps. The total number 
of computations in this algorithm is the same as that in the decimation-in-time 
algorithm. 


5.4 Appendix 5.1 

We show that 


JV 0 -1 

gjmUok _ 

fc=0 


N 0 

0 


m = 0, ±IVo, ±2JVo, . . . 

otherwise 


(5.43) 


Recall that tt 0 No = 2tt and e^ mn ° k = 1 for m = 0, ±N 0 , ±2N 0 , . . . , so that 

JVo — 1 JV 0 — 1 

Y e jmn ° k = Y 1 = No for m = 0,±JVo,±2Ar o ,... 

fc=0 k=o 


To compute the sum for other values of m, we note that the sum on the left-hand side 
of Eq. (5.43) is a geometric progression with common ratio a = e-’ mn °. Therefore, 
(see Sec. B.7-4) 


JV 0 — x 

e jmClok _ 

fc= 0 


e jmCloNo _ ^ 
gjmflo ^ 


= 0 


^gjmSloNo _ gj27rm 


= i) 


f Actually, is a conservative figure because some multiplications corresponding to the cases 

where = l,j, etc., are eliminated. 
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5.5 Summary 

A signal bandlimited to B Hz can be reconstructed exactly from its samples 
if the sampling rate F s > 2 B Hz (the sampling theorem). Such a reconstruction, 
although possible theoretically, poses practical problems such as the need for filters 
with zero gain over a band (or bands) of frequencies. Such filters are unrealizable, 
or realizable with infinite time delay. Therefore, in practice, there is always an error 
in reconstructing a signal from its samples. Moreover, practical signals are not ban- 
dlimited, which causes an additional error (aliasing error) in signal reconstruction 
from its samples. Aliasing error can be eliminated by bandlimiting a signal to its 
effective bandwidth. 

The sampling theorem is very important in signal analysis, processing, and 
transmission because it allows us to replace a continuous-time signal with a discrete 
sequence of numbers. Processing a continuous-time signal is therefore equivalent to 
processing a discrete sequence of numbers. This leads us directly into the area of 
digital filtering (discrete-time systems). In the field of communication, the trans- 
mission of a continuous-time message reduces to the transmission of a sequence of 
numbers. This opens doors to many new techniques of communicating continuous- 
time signals by pulse trains. 

The dual of the sampling theorem states that for a signal timelimited to r 
seconds, its spectrum F(u) can be reconstructed from the samples of F(u) taken 
at uniform intervals not greater than 1/r Hz. In other words, the spectrum should 
be sampled at a rate not less than r samples/Hz. 

To compute the direct or inverse Fourier transform numerically, we need a rela- 
tionship between the samples of / (t) and F( w). The sampling theorem and its dual 
provide such a quantitative relationship in the form of a discrete Fourier transform 
(DFT). The DFT computations are greatly facilitated by a fast Fourier transform 
(FFT) algorithm, which reduces the number of computations from something of the 
order of iV| to A 0 log JVo. 
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Problems 

5.1-1 Figure P5.1-1 shows Fourier spectra of signals /i(i) and f 2 (t). Determine the Nyquist 
sampling rates for signals /i(t), f 2 (t), /?(<), fl{t), and fi(t)h(t). 
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5.1- 2 Determine the Nyquist sampling rate and the Nyquist sampling interval for the 

signals (a) sine 2 (lOOtrf) (b) 0.01 sine 2 (1007rf) (c) sinc(lOOrrf) + 3 sine 2 (60jrf) (d) 
sine (507rt)sinc (lOOirf). 

5.1- 3 A signal /(f) = sine (200xt) is sampled (using uniformly spaced impulses) at a rate of 

(a) 150 Hz (b) 200 Hz (c) 300 Hz. For each of the three cases (i) sketch the spectrum 
of the sampled signal, (ii) explain if you can recover the signal /(f) from the sampled 
signal, (iii) if the sampled signal is passed through an ideal lowpass filter of bandwidth 
100 Hz, sketch the spectrum of the output signal. 

5.1- 4 One realization of a practical zero-order hold circuit is presented in Fig. P5.1-4. 

(a) Find the unit impulse response of this circuit. Hint: Recall that the impulse 
response h(t ) is the output of the circuit in Fig. P5.1-4 when the input /(f) = 6(t). 

(b) Find the transfer function H(ui ), and sketch |H(w)|. 

(c) Show that when a sampled signal /(t) is applied at the input of this circuit, the 
output is a staircase approximation of f(t). The sampling interval is T. 



5.1- 5 (a) A first-order hold circuit can also be used to reconstruct a signal /(f) from its 

samples. The impulse response of this circuit is 

W)-A(i) 

where T is the sampling interval. Consider a typical sampled signal /(t) and show 
that this circuit performs the linear interpolation. In other words, the filter output 
consists of sample tops connected by straight line segments. Follow the procedure 
discussed in Sec. 5.1-1 (Fig. 5.3b). 

(b) Determine the transfer function of this filter, and its amplitude response, and 
compare it with the ideal filter required for signal reconstruction. 

(c) This filter, being noncausal, is unrealizable. By delaying its impulse response, 
the filter can be made realizable. What is the minimum delay required to make 
it realizable? How would this delay affect the reconstructed signal and the filter 
frequency response? 

(d) Show that the filter in part (c) can be realized by a filter depicted in Fig. P5.1-4 
followed by an identical filter in cascade. Hint: show that the impulse response of 
this circuit is A(^) delayed by T seconds. 

5.1- 6 A signal /(f) = sinc(200;rt) is sampled by a periodic pulse train pr(t) resented in 

Fig. P5.1-6. Find and sketch the spectrum of the sampled signal. Explain if you 


Pj O «i * 0.8 ms 

1 I — I r— i r—i »— i 


• 4 ms 8 ms ( 

Fig. P5.1-6 

will be able to reconstruct /(t) from these samples. If the sampled signal is passed 
through an ideal lowpass filter of bandwidth 100 Hz and unit gain, find the filter 
output. What is the filter output if its bandwidth is B Hz, where 100 < B < 150? 
What will happen if the bandwidth exceeds 150 Hz? 



Fig. P5.1-7 Flat top sampling. 


5.1- 7 In Example 5.3, the sampling of a signal /(t) was accomplished by multiplying the 

signal by a pulse train pr(t), resulting in the sampled signal depicted in Fig. 5.8d. 
This procedure is known as the natural sampling. Figure P5.1-7 shows the so called 
flat top sampling of the same signal /(f) = sinc 2 ( 57 rf). 

(a) Show that the signal /(f) can be recovered from flat top samples if the sampling 
rate is no less than the Nyquist rate. 

(b) Explain how you would recover /(f) from the flat top samples. 

(c) Find the expression for the sampled signal spectrum F( iv) and sketch it roughly. 
Hint. First show that the flat top sampled signal can be generated by passing the 
signal f(t)6r{t) through a filter whose impulse response is h(t) = p x (t). For signal 
recovery from the samples, follow the reverse procedure. 

5.1- 8 A compact disc (CD) records audio signals digitally by using PCM. Assume the audio 

signal bandwidth to be 15 kHz. 

(a) What is the Nyquist rate? 

(b) If the Nyquist samples are quantized into 65536 levels (L = 65536) and then 
binary-coded, what number of binary digits is required to encode a sample. 

(c) Determine the number of binary digits/s (bits/s) required to encode the audio 
signal. 

(d) For practical reasons discussed in the text, signals are sampled at a rate well 
above the Nyquist rate. Practical CDs use 44100 samples/s. If L = 65536, determine 
the number of pulses/ s required to encode the signal. 

5.1-9 A TV signal (video and audio) has a bandwidth of 4.5 MHz. This signal is sampled, 
quantized and binary-coded to obtain a PCM (pulse code modulated) signal. 

(a) Determine the sampling rate if the signal is to be sampled at a rate 20% above 
the Nyquist rate. 

(b) If the samples are quantized into 1024 levels, what number of binary pulses is 
required to encode each sample. 

(c) Determine the binary pulse rate (bits/s) of the binary coded signal. 
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-10 Prove that a signal cannot be simultaneously timelimited and bandlimited. 

Hint: Show that contrary assumption leads to contradiction. Assume a signal si- 
multaneously timelimited and bandlimited so that F(u>) = 0 for |u)| > 2irB. In this 
case F(u) = F(w)rect (3757) for B' > B. This fact means that /(t) is equal to 
/(t) * 2B'sinc (2rr B't). The latter cannot be timelimited because the sine function 
tail extends to infinity. 

2-1 For a signal /(t) that is timelimited to 10 ms and has an essential bandwidth of 10 
kHz, determine N 0t the number of signal samples necessary to compute a power of 
2-FFT with a frequency resolution J~ 0 of at least 50 Hz. Explain if any zero padding 
is necessary. 



2-2 To compute the DFT of signal /(t) in Fig. P5.2-2, write the sequence } k (for k = 0 to 
JV 0 — 1) if the frequency resolution To must be at least 0.25 Hz. Assume the essential 
bandwidth (the folding frequency) of f(t) to be at least 3 Hz. Do not compute the 
DFT; just write the appropriate sequence /*,. 

2-3 Choose appropriate values for No and T and compute the DFT of the signal e 'u(t). 
Use two different criteria for determining the effective bandwidth of e~‘u( f )- Use the 
bandwidth to be that frequency where the amplitude response drops to 1% of its peak 
value (at in = 0). Next, use the 99% energy criterion for determining the bandwidth 
(see Example 4.16). 

2-4 Repeat Problem 5.2-3 for the signal 



Fig. P5.2-5 

.2-5 For the signals f(t) and g(t) resented in Fig. P5.2-5, write the appropriate sequences 
fh and gk necessary for the computation of the convolution of /(t) and g(t) using 
DFT. Use T = §. 



Continuous-Time System Analysis 
Using the Laplace Transform 


The Fourier transform is a tool which allows us to represent a signal /(t) as a 
continuous sum of exponentials of the form whose frequencies are restricted to 
the imaginary axis in the complex plane (s = jut). As we saw in Chapters 4 and 5, 
such a representation is quite valuable in the analysis and processing of signals. In 
the area of system analysis, however, the use of Fourier transform leaves much to 
be desired. First, the Fourier transform exists only for a restricted class of signals 
and, therefore, cannot be used for such inputs as growing exponentials. Second, 
the Fourier transform cannot be used easily to analyze unstable or even marginally 
stable systems. 

6.1 The Laplace Transform 

The basic reason for both these difficulties is that for some signals, such as 
e at u(t) ( a > 0), the Fourier transform does not exist because ordinary sinusoids or 
exponentials of the form e JU,t (on account of their constant amplitudes) are incapable 
of synthesizing exponentially growing signals. This problem could be resolved if it 
were possible to use basis signals of the form e 3t (instead of e Ja,t ), where the complex 
frequency s is not restricted to just the imaginary axis (as in the Fourier transform). 
This is precisely what is done in the following extended transform known as the 
bilateral Laplace transform, where the frequency variable s = ju is generalized 
to a = a+jui. Such generalization permits us to use exponentially growing sinusoids 
to synthesize a signal f(t). Before developing the mathematical operations required 
for such an extension, we will find it illuminating to have an intuitive understanding 
of such a generalization. 

6.1-1 Intuitive Understanding of the Laplace Transform 

If a signal f{t) shown in Fig. 6. Id is not Fourier transformable, we may be 
able to make it Fourier transformable by multiplying it with a decaying exponential 
such as e -l7t .tFor example, a signal e 2t u(t) can be made Fourier transformable by 
multiplying it with e~ at with a > 2. Let 

(This assumes that |/(t)| < Me* 1 for some real, positive, and finite numbers M and a. Such 
signals are called exponential-order signals. Signals which do not satisfy this condition may not 
be Laplace transformable. 
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m = f(.t)e~ at 

as depicted in Fig. 6.1a. The signal <j>(t) is now Fourier transformable and its Fourier 
components are of the form with frequencies u varying from u = -oo to oo. 
The exponential components e-’ u,t and e~^ ut in the spectrum add to give a sinusoid 
of frequency u. The spectrum contains an infinite number of such sinusoids, each 
having an infinitesimal amplitude. It would be very confusing to draw all these 
components; hence, in Fig. 6.1b, we show just two typical components. Addition 
of all such components (infinite in number) results in 4>(f), illustrated in Fig. 6.1a. 
The exponential spectral components of <j>(t) are of the form e with complex 
frequencies ju lying on the imaginary axis from u = -oo to oo, as shown in Fig. 
6.1c. 

Figure 6.1a shows a signal = f(t)e~' Tt , Fig. 6.1b shows two of its infinite 
spectral components, and Fig. 6.1c shows the location in the complex plane of the 
frequencies of all the spectral components of <p(t). Now, the desired signal /(f) can 
be obtained by multiplying with e CTt . This fact means that we can synthesize 
/(f) by multiplying each spectral component of <f>(t) with e at and adding them. But 
multiplying the spectral components of 0(f) (sinusoids in Fig. 6.1b) with e at results 
in the exponentially growing sinusoids as shown in Fig. 6.1e. Addition of all such 
exponentially growing sinusoids (infinite in number) results in }{t ) in Fig. 6. Id. 
The spectral components of <f>(t) are of the form e- , “ t . Multiplication of these com- 
ponents with e at results in the spectral components of the form e at e^ ut = e*' <T+ i u ' ,t . 
Therefore, a component of frequency ju in the spectrum of <j>(t) is transformed into 
a component of frequency a + ju in the spectrum of /(f). The location in the 
complex plane of the frequencies a + ju is along a vertical line, depicted in Fig. 
6. If. 

It is clear that a signal /(f) can be synthesized with growing everlasting expo- 
nentials lying along the path a + ju, with u varying from -oo to oo. The value 
of a is flexible. For example, if /(f) = e 2t u(t), then = f(t)e~‘ rt can be made 
Fourier transformable if we choose a > 2. Thus, there are infinite choices for a. 
This means the spectrum of /(f) is not unique, and there are infinite possible ways 
of synthesizing /(f). Nevertheless, a has a certain minimum value cro for a given 
/(f) [cro = 2 for /(f) = e 2t u(f)]. The region in the complex plane where a > cro 
(Fig. 6.1g) is called the region of convergence (or existence) of the resulting 
transform of /(f). 

All these conclusions reached here by pure heuristic reasoning will now be 
derived analytically. The frequency ju in the Fourier transform will be generalized 
to s = a + ju. 


6.1-2 Analytical Development of the Bilateral Laplace Transform 


Because we are unifying the Fourier and Laplace transforms, we need to use 
here the unified notation F(ju) instead of F(u) for the Fourier transform, which is 
given by 
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.aplace transform. 
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1 

/W=2 -j F{ju)e 3u,t du 

Consider now the Fourier transform of /(t)e _<rt {a real) 


)e jhJi duj 

(6.2) 

(tr real) 


~ot e ~jut dt 

(6.3) 

~(a+j U )t dt 

(6.4) 


It follows from Eq. (6.1) that the above integral is F(a + ju>). Thus 

r{f(t)e-^] = F(cr+ju) (6.5) 

The inverse Fourier transform of the above equation yields 

1 r°° 

f(t)e ' rt = — F(a + ju)e 3ult du (6.6) 

J- oo 

Multiplying both sides with e at yields 

/(*) = 7r- [ F(cr + jw)e (<,+3U '>‘ duj (6.7) 

^ J — OO 

The quantity (<r + ju>) is the complex frequency s. We now change the variable 
in this integral from u to s. Because s = a + ju>, dut = (1 /j)ds. The limits of 
integration from u = -oo to oo now become from ( a - j oo) to (a + joo) for the 
variable s. Recall, however, that for a given f(t) , a has a certain minimum value 
(To, and we can select any value of <r > cto- In general, we can let the limits of 
integration range from s = c - joo to s = c + joo, where c > a 0 . Thus, Eq. (6.7) 
becomes 

i rC+jo O 

f(t)=— / F(s)e st ds (6.8a) 

^3 J C— 700 


From Eqs. (6.4) and (6.5), we obtain 


f(t)e st dt 


This pair of equations is known as the bilateral Laplace transform pair (or the 
two-sided Laplace transform pair). The bilateral Laplace transform will be 
denoted symbolically as 


or simply as 


F(s) = £[/(t)] and /(«) = £ 1 [F(s)] 
f(t) F(s) 


6.1 The Laplace Transform 
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Response of LTIC Systems 

Equation (6.8a) expresses f(t) as a weighted sum of exponentials of the form 
e 3t . This point becomes clear when we write the integral in Eq. (6.8a) as a sum 

1 rc+joo 

= — F( s )e st ds 


1 fC-tjoo 

f(t) = X— / F( s )e st ds 
Jc— joo 

= lim y ^("As)Asf e(nAa)t 

As— *0 ' 27T7 

« = — rvi J J 


Clearly, the Laplace transform expresses f(t) as a sum of everlasting exponentials 
of the form e< nAs > i along the path c - joo to c + joo with c > <r 0 . These are 
exponentially growing (if c > 0) or decaying (if c < 0) sinusoids. We can readily 
determine an LTIC system response to the input /(t) by observing that if the system 
transfer function is H(s), then, as demonstrated in Eq. (2.47), the system response 
to the (everlasting) exponential e ( nAs ) 1 is F(nAs)c! nA, ) t . From Eq. (6.9), it follows 
that the system response to the input f(t) is 

y(t)= lim y gfrAf)g( ? 1 (nA,)t 

Aa-o ^ 2iri 


1 fc'+joo 

= — / F(s)H(s)e 3t ds 
Jc'-joo 


The path of integration (from c' — joo to c' + joo) in Eq. (6.10) may be different 
from that in Eq. (6.9) to allow for the convergence of the integral in Eq. (6.10). This 
subtle point will be discussed later in Sec. 6.8-1. If y(t) <=> Y(s), then according 
to Eq. (6.10) it follows that 

Y(s) = F(s)H( S ) (6.11) 

Here, we have expressed the input /(t) as a sum of exponentials components of 
the form e st . The system response is then obtained by adding the responses to all 
these exponential components. The procedure followed here is identical to that in 
chapter 2 (where the input is expressed as a sum of impulses) or chapter 4 (where 
the input is expressed as a sum of exponentials of the form e J " 4 ). 

In conclusion, we have shown that for an LTIC system with transfer function 
H{s), if the input and the output are }(t) and y(t), respectively, and if 


Y(s) = F(s)H( S ) (6.12) 

We shall derive this result more formally later. 

Linearity of the Laplace Transform 

The Laplace transform is a linear operator, and the principle of superposition 
applies; that is, if 

/j(t) <=>■ Fi(s) and f 2 (t) «=*• F 2 (s) 


“l/l(t) + a 2 f 2 (t) <=4> aiFi(s) + a 2 F 2 (s) 
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The proof is trivial and follows directly from the definition of the Laplace transform. 
This result can be extended to any finite number of terms. 

The Region of Convergence 

Earlier, we discussed the intuitive meaning of the region of convergence (or 
region of existence) of the Laplace transform F(s). Mathematically, the region of 
convergence for F(s) is the set of values of s (the region in the complex plane) 
for which the integral in Eq. (6.8b) defining the direct Laplace transform F(s) 
converges. This concept will become clear in the following example. 

■ Example 6.1 

For the signal /(f) = e~“‘u(t), find the Laplace transform F(s) and its region of 
convergence. 

By definition 

/ OO 

e~ at u(t)e~ st dt 

•OO 

Because u(t) = 0 for t < 0 and u(£) = 1 for t > 0, 

/'OO r OO - | oo 

F(s)= / e~ at e~ st dt = / e - (>+ “ )t dt = L_ e -U+<*)t (6.14) 

Jo Jo s + a \ 0 

Note that s is complex and as t — * oo, the term e ~ (a+a)t does not necessarily vanish. Here 
we recall that for a complex number z = a + j/3, 


e ~*< _ g -(a+J0)t _ g-atg-J/3* 


Now |e j45t | 

= 1 regardless of the value of 0t. Therefore, as t —> oo, 

e _2t — > 0 only if 

a > 0, and e 

24 — * oo if a < 0. Thus 




lim e _2t = < 

t— »oo 

j 0 Re z > 0 

t oo Re z < 0 

(6.15) 

Clearly 

lim e~<’ +a)t = 1 

t— *oo | 

' 0 Re (s + a) > 0 

k oo Re (s + a) < 0 


Use of this result in Eq. (6.14) yields 




FIs) = — — Re (s + a) > 0 

s + a 

(6.16a) 

or 

e at u(t ) <=> 

— - — Re s > — a 

s + a 

(6.16b) 


The region of convergence of F(s) is Re s > —a, as shown in the shaded area in Fig. 6.2a. 
This fact means that the integral defining F(s) in Eq. (6.14) exists only for the values of 
s in the shaded region in Fig. 6.2a. For other values of s, the integral in Eq. (6.14) does 
not converge. For this reason the shaded region is called the region of convergence (or the 
region of existence) for F(s). 

Recall that the Fourier transform of e~ o4 u(t) does not exist for negative values of a. 
In contrast, the Laplace transform exists for all values of a, and its region of convergence 
is to the right of the line Re s = -a. I 
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Fig. 6.2 Signals e at u(t) and —e at u{—t) have the same Laplace transform but different 
regions of convergence. 


Role of the Region of Convergence 

The region of convergence is required for evaluating the inverse Laplace trans- 
form f(t) from F(s) as defined by Eq. (6.8a). The operation of finding the inverse 
transform requires an integration in the complex plane, which needs some expla- 
nation. The path of integration is along c + ju, with ui varying from -oo to oo. 
Moreover, the path of integration must lie in the region of convergence (or existence) 
for F(s). For the signal e~ at u(t), this is possible if c > -a. One possible path of 
integration is shown (dotted) in Fig. 6.2a. Thus, to obtain f(t) from F(s), the 
integration in (6.8a) is performed along this path. When we integrate [1/ (s + a)]e sf 
along this path, the result is e~ at u(t). Such integration in the complex plane re- 
quires a background in the theory of functions of complex variables. We can avoid 
this integration by compiling a table of Laplace transforms (Table 6.1), where the 
Laplace transform pairs are tabulated for a variety of signals. To find the inverse 
Laplace transform of say, l/(s + a), instead of using the complex integral (6.8a), we 
look up the table and find the inverse Laplace transform to be e~ at u(t). Although 
the table given here is rather short, it comprises the functions of most practical 
interest. A more comprehensive table appears in Doetsch. 1 

The Unilateral Laplace Transform 

In order to understand the need for defining a unilateral transform, let us find 
the Laplace transform of signal f(t) illustrated in Fig. 6.2b 

f(t) = —e~ ai u(—t) 

The Laplace transform of this signal is 



-e at u(—t)e~ st dt 
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Because u(—t) = 1 for t < 0 and u(— t) = 0 for t > 0, 

F(s) = f —e~ at e~ st dt = — f e“ (s+a)t dt = — e -(s+a)t 

J~o o J — oo s + n — oo 

Equation (6.15) shows that 

lim e _ ( s +“) t = o Re (s + a) < 0 

t—*~ OO 

Hence 

fr(s) = _L_ Re s < — a (6.17) 

S -j- fl 

The signal -e _of u(-f) and its region of convergence (Re s < -a) are depicted in 
Fig. 6.2b. Note that the Laplace transforms for the signals e~ at u(t ) and -e~ at u(-t) 
are identical except for their regions of convergence. Therefore, for a given F(s), 
there may be more than one inverse transform, depending on the region of conver- 
gence. In other -words, there is no one-to-one correspondence between F(s) and /(t), 
unless the region of convergence is specified. This fact increases the complexity in 
using the Laplace transform. The complexity is the result of trying to handle causal 
as well as noncausal signals. If we restrict all our signals to the causal type, such an 
ambiguity does not arise. There is only one inverse transform of F(s) = l/(s + a), 
namely, e~ at u(t). To find /(t) from F(s), we need not even specify the region of 
convergence. In summary, if all signals are restricted to the causal type, then, for a 
given F(s), there is only one inverse transform f(t ). f 

The unilateral Laplace transform is a special case of the bilateral Laplace trans- 
form, where all signals are restricted to being causal; consequently the limits of 
integration for the integral in Eq. (6.8b) can be taken from 0 to oo. Therefore, the 
unilateral Laplace transform F(s) of a signal /(f) is defined as 

F(s)= I" f{t)e~ st dt (6.18) 

Jo- 

We choose 0“ (rather than 0+ used in some texts) as the lower limit of integration. 
This convention not only ensures inclusion of an impulse function at t = 0, but 
also allows us to use initial conditions at 0“ (rather than at 0 + ) in the solution 
of differential equations via the Laplace transform. In practice, we are likely to 
know the initial conditions before the input is applied (at 0"), not after the input 
is applied (at 0 + ). Other advantages of this convention appear on p. 392. 

The unilateral Laplace transform simplifies the system analysis problem con- 
siderably, but the price for this simplification is that we cannot analyze noncausal 
systems or use noncausal inputs. However, in most practical problems this is of 
little consequence. For this reason, we shall first consider the unilateral Laplace 
transform and its application to system analysis. (The bilateral Laplace transform 
is discussed later in Sec. 6.8.) 

Observe that basically there is no difference between the unilateral and the 
bilateral Laplace transform. The unilateral transform is the bilateral transform 
that deals with a subclass of signals starting at f = 0 (causal signals). Therefore, 
the expression [(Eq. (6.8a)] for the inverse Laplace transform remains unchanged. 
In practice, the term Laplace transform means the unilateral Laplace transform. 

t Actually, F(s ) specifies /(f) within a null function n(t) which has the property that the area 
under |n(t)| 2 is zero over any finite interval 0 to t (t > 0) (Lerch’s theorem). For example, if two 
functions are identical everywhere except at points of discontinuity, they differ by a null function. 
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Existence of the Laplace Transform 

The variable s in the Laplace transform is complex in general, and it can be 
expressed as s = u + jui. By definition 

/ OO 

}{t)e~ st dt 


pOO 

= / [f^e-^e-^dt 

J o- 


Because |e Ja *| = 1, the integral on the right-hand side of this equation converges if 


rOO 

L !'“> 


e at \ dt < oo 


Hence the existence of the Laplace transform is guaranteed if the integral in (6.19) 
is finite for some value of a. Any signal that grows no faster than an exponential 
signal Me aot for some M and cr 0 satisfies the condition (6.19). Thus, if for some M 
and rro, 

1/(01 < Me° at ( 6 . 20 ) 

we can choose a > cro to satisfy (6.19).f The signal e* 2 , in contrast, grows at a rate 
faster than e ffot , and consequently e* is not Laplace transformable. Fortunately 
such signals (which are not Laplace transformable) are of little consequence from 
either a practical or a theoretical viewpoint. If po is the smallest value of a for 
which the integral in (6.19) is finite, cr 0 is called the abscissa of convergence and 
the region of convergence of F(s) is Re s > a o- The abscissa of convergence for 
e~ at u{t) is -a (the region of convergence is Re s > -a). 

I Example 6.2 

Determine the Lapiace transform of (a) 6(t) (b) u(t) (c) cos wo tu(t). 

(a) 

C [£(«)]= / S(t)e~’ 1 dt 

do- 

Using the sampling property [Eq. (1.24a)], we obtain 

C [6(t)] = 1 for all s 


(b) To find the Laplace transform of u(t), recall that u(t) = 1 for t > 0. Therefore 

/ oo r oo . |00 

u(t)e~ 3t dt = J e~ 3t dt — - -e~ st | 


Re s > 0 


-[Condition (6.20) is sufficient but not necessary for the existence of the Laplace transform. For 
example f(t) = I/'/i is infinite at t = 0 and, (6.20) cannot be satisfied, but the transform of l/v7 
exists and is given by yji t/s. 
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Fig. 6.3 Signals for Exercise E6.1. 

We also could have obtained this result from (6.16b) by letting a = 0. 

(c) Because 

cos u 0 tu(t) = i [e ju, °‘ + u(i) (6.23) 

C [cos wotu(i)] = i C [e ju>ot u(t) + e _J “ 0< u(t)j 
From Eq. (6.16), it follows that 


C [cos uiot u(t) 1 = i 1 

2 s - juiq s + ju o 


Re (s ± joj) = Re s > 0 


a 2 + uio 2 


Re s > 0 


For the unilateral Laplace transform, there is a unique inverse transform of 
F(s); consequently, there is no need to specify the region of convergence explicitly. 
For this reason, we shall generally ignore any mention of the region of convergence 
for unilateral transforms. Recall, also, that in the unilateral Laplace transform it is 
understood that every signal f(t) is zero for t < 0, and it is appropriate to indicate 
this fact by multiplying the signal by u(t). 

A Exercise E6.1 

By direct integration, find the Laplace transform F(s) and the region of convergence of F(s) 
for the signals shown in Fig. 6.3. 

Answer: (a) l(l-e~ 23 ) for all s. (b) i(l - e _2s )e -2j for all s. v 

Connection to the Fourier Transform 

The definition of the Laplace transform is identical to that of the Fourier trans- 
form with jut replaced by s. It is reasonable to expect F(s), the Laplace transform 
of /(f), to be the same as F(w), the Fourier transform of /(f) with ju replaced by 
s. For example, we found the Fourier transform of e~ at u(t) to be 1 /(ju + a). Re- 
placing ju with s in the Fourier transform results in l/(s + a), which is the Laplace 
transform as seen from Eq. (6.16b). Unfortunately this procedure is not valid for 
all /(f). We may use it only if the region of convergence for F(s) includes the 
imaginary (ju) axis. For instance, the Fourier transform of the unit step function 
is tt6(ui ) + (1/jw)- The corresponding Laplace transform is 1/s, and its region of 
convergence, which is Re s > 0, does not include the imaginary axis. In this case the 
connection between the Fourier and Laplace transforms is not so simple. The reason 
for this complication is related to the convergence of the Fourier integral, where the 
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path of integration is restricted to the imaginary axis. Because of this restriction, 
the Fourier integral for the step function does not converge in the ordinary sense 
as Example 4.7 demonstrates. We had to use a generalized function (impulse) for 
convergence. The Laplace integral for u(f), in contrast, converges in the ordinary 
sense, but only for Re s > 0, a region forbidden to the Fourier transform. Another 
interesting fact is that although the Laplace transform is a generalization of the 
Fourier transform, there are signals (e.g., periodic signals) for which the Laplace 
transform does not exist, although the Fourier transform exists (but not in the 
ordinary sense). 

6.1-3 Finding the Inverse Transform 

Finding the inverse Laplace transform by using the definition (6.8a) requires 
integration in the complex plane, a subject beyond the scope of this book. 2 For our 
purpose, we can find the inverse transforms from the transform table 6.1. All we 
need is to express F(s) as a sum of simpler functions of the form listed in the table. 
Most of the transforms F(s) of practical interest are rational functions; that is, 
ratios of polynomials in s. Such functions can be expressed as a sum of simpler 
functions by using partial fraction expansion (see Sec. B.5). Values of s for which 
F(s) = 0 are called the zeros of F(s); the values of s for which F(s) -* oo are 
called the poles of F(s). If F(s) is a rational function of the form P(s)/Q(s), the 
roots of P(s) are the zeros and the roots of Q(s) are the poles of F(s). 


I Example 6.3 

Find the inverse Laplace transforms of 
(a) ■ 78 ~ 6 ( b ) 252 + 5 ( C ) e( s + 34) 8s + 10 

s 2 -s-6 1 s 2 + 3s + 2 1 ' s(s 2 + 10s + 34) ( ’ ( s + 1 )( s + 2 )3 

The inverse transform of none of the above functions is directly available in Table 
6.1. We need to expand these functions into partial fractions discussed in Sec. B 5 
(a) 

F(s) = 7 “ — 6 

U ( 3 + 2)(s — 3) 

_ ki k 2 
s+2 s— 3 


To determine ki, corresponding to the term (s + 2), we cover up (conceal) the term (s + 2) 
in F(s) and substitute s = — 2 (the value of s that makes s + 2 = 0) in the remaining 
expression (see Sec. B.5-2) 



Similarly, to determine k 2 corresponding to the term (s - 3), we cover up the term (s - 3) 
in F{s ) and substitute s — 3 in the remaining expression 



21-6 
3 + 2 



Therefore 


(6.25a) 
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Table 6.1 

A Short Table of (Unilateral) Laplace Transforms 


m n*) 


1 i(t) i 

2 u(t) - 

s 

3 tu(t) 


4 t n u(t) 

5 e xt u(t) 

6 te xt u(t) 

7 t"e x ‘u(t) 

8 a cos bt u(t) 

8 b sin bt u(t) 

9a e~ at cos btu(t) 

9b e _ot sin btu(t) 

10a re~ at cos (bt + 8) u(t) 
106 re~ at cos (bt + 8) u(t) 
10c re~ at cos (bt + 8) u(t) 



n! 

s n+i 

1 

s — X 
1 

(« - ^) 2 
n! 

(s - A)»+> 
s 

s 2 + 6 2 
6 

s 2 + b 2 
s + a 

(s + a) 2 + b 2 
b 

(s + a) 2 + b 2 

(r cos 8)s + (ar cos 8 — br sin 0) 
s 2 + 2as + (a 2 + 6 2 ) 

0.5re j9 0.5re~ j9 

s + a - jb s + a + jb 

As + B 
s 2 + 2as + c 


As + B 
s 2 + 2 as + c 
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Checking the answer 

It is easy to make a mistake in partial fraction computations. Fortunately it is 
simple to check the answer by recognizing that F(s) and its partial fractions must 
be equal for every value of s if the partial fractions are correct. Let us verify this 
assertion in Eq. (6.25a) for some convenient value, say s = 1. Substitution of s = 1 
in Eq. (6.25a) yieldsf 

1 = 4 _ 3 _ 1 

6 — 3 2~ 6 

We can now be sure of our answer with a high margin of confidence. Using Pair 5 
(Table 6.1) in Eq. (6.25a), we obtain 




(6.25b) 


F(s ) = 2 * 2 + 5 = 2 * 2 + 5 

s 2 + 3s + 2 (s + l)(s + 2) 

Observe that F(s) is an improper function with m ~ n. In such a case we can 
express F(s) as a sum of the coefficient b n (the coefficient of the highest power in 
the numerator) plus partial fractions corresponding to the poles of F(s) (see Sec. 
B.5-4). In the present case b n = 2. Therefore 

F(s) = 2-1 — — 1 — 

s+1 s+2 

where 

_ 2s 2 + 5 I 2 + 5 


Therefore 


• + 2)L_j -1 + 2 


__2^_^5 
F(s) = 2 + 


s + 1 s + 2 


From Table 6.1, Pairs 1 and 5, we obtain 


(c) 


f(t) = 2 S(t) + (7e _ * - 13e _2t ) u(t) 

= 6(s + 34) 

v ' s(s 2 + 10s + 34) 

= 6(s + 34) 

s(s + 5 — j3)(s + 5 + j3) 

_ + ^2 k 2 * 

s s + 5-j3 s + 5+j3 


(6.26) 


t Because F(s) = oo at its poles, we should avoid the pole values (-2 and 3 in the present case) 
for checking. It is possible that the answers may check even if partial fractions are wrong. This 
situation can occur when two or more errors cancel their effects. But the chances of this problem 
arising for randomly selected values of s are extremely small. 
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Note that the coefficients (£2 and £ 2 *) of the conjugate terms must also be conjugate 
(see Sec. B.5). Now 

, 6(s + 34) I _ 6 x 34 


6 (s + 34) 

18IS(s + 5 +7 3 ) 


29 + j3 
-3 - j5 


= -3 + j 4 


Therefore 


k 2 * = -3 - j 4 

To use Pair 10b (Table 6.1), we need to express k 2 and Jt 2 * in polar form. 

-3 + ji = (\/3 2 + 4 2 ) gj tan -1 (4/— 3) = 5e j tan-‘(4/-3) 

Observe that tan -1 ^) ^ tan _1 (-|). This fact is evident in Fig. 6.4. Remember 
that electronic calculators can give answers only for the angles in the first and the 
fourth quadrant. For this reason it is important to plot the point (e.g. -3 + j 4) 
in the complex plane, as depicted in Fig. 6.4, and determine the angle. For further 
discussion of this topic, see Example B.l. 

From Fig. 6.4, we observe that 

fc 2 = —3 -t-j'4 = 5e ,126 ' 9 ° 


so that 


Therefore 


fc 2 * = 


, 6 5e^ 26 - 9 ° 5e~ jl26 ' 9 ° 

F ^ " s + s + 5- j3 + s + 5 + j3 


From Table 6.1 (Pairs 2 and 10b), we obtain 


f{t) = [6 + 10e -5t cos (3t + 126.9°)] u(t) 


3+/4 \ 

>4 

\ 

126.9° 

-3 

J-sir 


# 


3-14 

Fig. 6.4 tan -1 

^)^tan-'(^) 
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Alternative Method Using Quadratic Factors 

The above procedure involves considerable manipulation of complex numbers. As 
indicated by Pair 10c (Table 6.1), the inverse transform of quadratic terms (with complex 
conjugate poles) can be found directly without having to find first-order partial fractions. 
We now show the alternative method (also discussed in Sec. B.5-2), which uses this obser- 
vation. For this purpose we shall express F(s) as 

F(s) = 6 ( s + 34 ) _ *1 As + B 

s(s 2 + 10s + 34) s + s 2 4- 10s + 34 

We have already determined that ki = 6 by the (Heaviside) “cover-up” method. Therefore 

6(s + 34) 6 As + B 

s(s 2 + 10s + 34) “ s + s 2 + 10s + 34 

Clearing the fractions by multiplying both sides by s(s 2 + 10s + 34) yields 

6(s + 34) = 6 (s 2 + 10s + 34) + s(As + B) 

= (6 + A)s 2 + (60 + B)s + 204 

Now, equating the coefficients of a 2 and s on both sides yields 

0 = (6 + A) =4 A = -6 
6 = 60 + B =*■ B = -54 



The partial fractions with quadratic terms also can be obtained by using short cuts. 
We have 

, = 6(» + 34) = 6 As + B 

' s(s 2 + 10s + 34) s s 2 + 10s + 34 

We can determine A by eliminating B on the right-hand side. This step can be accom- 
plished by multiplying both sides of the above equation by s and then letting s —* 00. 
This procedure yields 

0 = 6 + A => A = —6 


Therefore 

6(s + 34) _ 6 -6s + B 

s(s 2 + 10s + 34) s s 2 + 10s + 34 

To find B, we let s take on any convenient value, say s = 1, in this equation to obtain 
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210 _ B - 6 

45 + 45 

Multiplying both sides of this equation by 45 yields 

210 = 270 + B - 6 => B = -54 
a deduction which agrees with the results we found earlier. 

(d) 


where (see Sec. B.5-2) 


(s + l)(a + 2)3 

fci no ai Q2 

a + 1 (s + 2) 3 (s + 2) 2 s + 2 


8s + 10 

a(i+2i 3 


8s + 10 

(s+imm 

_ ( d_ 8s 

( ds (s + 1 

i (£_ _ 

! 2 \ds* [(s- 


} = ~ 2 


8 s 4 10 

Fij* 


Therefore 


2 6 2 2 
W ~ a + 1 + (s + 2) 3 (s + 2) 2 s + 2 

and 

f{t) = [2e~* + (3t 2 - 2t - 2)e~ 2t ] u(t) (6.28) 

Alternative Method: A Hybrid of Heaviside and Clearing Fractions 

In this method, the simpler coefficients fci and ao are determined by the Heaviside 
“cover-up” procedure, as discussed earlier. To determine the remaining coefficients, we 
use the clearing-fraction method (see Sec. B.5-3). Using the values fci = 2 and ao = 6 
obtained earlier by the Heaviside “cover-up” method, we have 

8s + 10 _ 2 6 Gl CL2 

(s + l)(s + 2)3 = 7TT + (s + 2) 3 + (s + 2) 2 + 7+2 

We now clear fractions by multiplying both sides of the equation by (s 4 l)(s 4 2) 3 . This 
procedure yields - } - 

8s 4 10 = 2(s 4- 2) 3 + 6(s + 1) 4 ai(s + l)(s 4- 2) 4 a2(s + 1 )(s + 2) 2 

— (2 4- a2)s 3 4* (12 -4 ai 4* 5a2)s -I- (30 4 3ai 4 8a2)s 4 (22 4 2ai 4 4a2) 


fWe could have cleared fractions without finding fci and ao- This alternative, however, proves 
more laborious because it increases the number of unknowns to 4. By predetermining fci and ao, 
we reduce the unknowns to 2. Moreover, this method provides a convenient check on the solution. 
This hybrid procedure achieves the best of both methods. 
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Equating coefficients of s 3 and s 2 on both sides, we obtain 

0 = (2 4- 02) =£ > a2 = —2 
0 = 12 4 ai 4 5a2 = 2 4 ai =£• ai = —2 

We can stop here if we wish, since the two desired coefficients ai and <22 have already been 
found. However, equating the coefficients of s 1 and s° serves as a check on our answers. 
This step yields 


8 — 30 4 3ai 4 8a2 
10 = 22 4 2a 1 4 4a2 

Substitution of ai = a2 = —2, obtained earlier, satisfies these equations. This step assures 
the correctness of our answers. 

Another Alternative: A Hybrid of Heaviside and Short-Cuts 

In this method, the simpler coefficients fci and ao are determined by the Heaviside 
“cover-up” procedure, as discussed earlier. The usual short-cuts are then used to determine 
the remaining coefficients. Using the values fci = 2 and ao = 6, determined earlier by the 
Heaviside method, we have 

8s 4 10 _ 2 6 ai a2 

(s 4 l)(s 4 2)3 “ 5 4 1 (s 4 2)3 + ( s 4 2) 2 + 7+2 

There are two unknowns, ai and 02. If we multiply both sides by s and then let 5 — ► 00, 
we eliminate ai. This procedure yields 


Therefore 


0 — 2 4 a2 =>■ a2 = —2 

8s 4 10 2 6 ai 2 

(s + 1)(» + 2) 3 = 7+T + (s + 2) 3 + (s + 2) 2 ~ 7T2 


There is now only one unknown, ai. This value can be determined readily by setting s 
equal to any convenient value, say s - 0. This step yields 



+ U a i-i 

4 4 


O Computer Example C6.1 

Find the inverse laplace transform of the following functions using partial fraction 
expansion method: 


,_■> 2s 2 + 5 ^ 2s 2 + 7s + 4 , , 8s 2 + 21s + 19 

1 s* + Zs + 2 ( j (s + l)(s + 2) 2 C (s + 2)(s 2 + s + 7) 

( a ) 

num=[2 0 5]; den=[l 3 2]; 

[r,p,k]=residue(num,den) 
r - -13, 7 
P - -2, -1 
k - 2 
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Thus, 

+ and f(t) = (— 13e -2t + 7e~‘)u(t) + 2S(t) 

(b) 

num=[2 7 4]; den=[conv(conv([l 1],[1 2]),[1 2])]; 

[r, p, k]= residue(num,den); 

r = 3, 2, -1 
p = -2, -2, -1 

k - [ ] 

Hence, F(s) = + j-2— - -L. and /(*) = (3e~ 2t + 2te~ 2t - <r‘)«(<) 

(c) 

num=[8 21 19]; den=[conv([0 1 2],[1 1 7])]; 

[r, p, k]= residue(num,den) 

[angle, mag] =cart2pol(real(r),imag(r)) 
r = 3 . 5 - 0.481U, 3.5 + 0.481U, 1.00 
p « -0.5 +• 2.598H, -0.5 - 2.5981i, -2.00 
k - [ ] 

angle = -0.1366, 0.1366, 0 
mag - 3.5329, 3.5329, 1.00 


1 3 5390 p“i0-1366 q £090^0,1366 

Hence, F(a) = — + + . ' e 

a + 2 a + 0.5 - J2.5981 s + 0.5 + j2.5981 


/(<) = [e" 2t + 1.766 e“ 0 5t cos (2.598U- 0.1366)] u(t) 0 

Q Computer Example C6.2 

Find (a) the direct Laplace transform of sin at + cos bt (b) the inverse Laplace 
transform of (as 2 )/(s 2 + b 2 ). 

Here we shall use Symbolic Math Toolbox, which is a collection of functions for 
MATLAB used for manipulating and solving symbolic expressions. 

(a) 

f=sym(’sm(a*t)+cos(b*t)’); 

F=laplace(f) 

F=(a*s"2+b"2*a+s‘3+s*a“2)/(s*2+a‘2)/(s~2+b‘2) 


s 3 + as 2 + o 2 s + b 2 a 
(s 2 + a 2 )(s 2 + 6 2 ) 


F=sym(’(a*s‘2)/(s‘2+b‘2); 

f=invlaplace(F) 

F=a«dirac ( t ) -a»b»sin (b*t ) 


Thus, 


}{t) = aS(t) + absin(bt)u(t) 


6.1 The Laplace Transform 
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A Exercise E6.2 

(i) Show that the Laplace transform of 10e -3t cos (4t + 53.13°) is — 6s ~ 14 u se 

10a from Table 6.1. s 2 + 6s + 25 

(ii) Find the inverse Laplace transform of: (a) — — 17 — no ~ 5 

s 2 + 4s — 5 ’ (s + 1)(s 2 + 2s + 5) 

( ) 16s + 43 

(s-2)(s + 3) 2 

Answers: (a) (3e‘ - 2 e~ 5 ‘) u(t) (b) [-2 e - ( + | e -* cos (2t - 36.87°)] u(t) 

(c) [3e 2( + (t - 3)e- 3t ] u(t) V 


A Historical Note: Marquis Pierre-Simon De Laplace (1749-1827) 

The Laplace transform is named after the great French mathematician and 
astronomer Laplace, who first presented the transform and its applications to dif- 
ferential equations in a paper published in 1779. 

Laplace developed the foundations of potential theory and made important 
contributions to special functions, probability theory, astronomy, and celestial me- 
chanics. In his Exposition du systeme du Monde (1796), Laplace formulated a 
nebular hypothesis of cosmic origin and tried to explain the universe as a pure 
mechanism. In his Traite de Mechanique Celeste ( celestial mechanics), which com- 
pleted the work of Newton, Laplace used mathematics and physics to subject the 
solar system and all heavenly bodies to the laws of motion and the principle of 
gravitation. Newton had been unable to explain the irregularities of some heavenly 
bodies, in desperation, he concluded that God himself must intervene now and then 
to prevent some catastrophes, such as Jupiter eventually falling into the sun (and 
the moon into the earth) as predicted by Newton’s calculations. Laplace proposed 
to show that these irregularities would correct themselves periodically, and that a 
little patience in Jupiter’s case, 929 years — would see everything returning auto- 
matically to order, and there was no reason why the solar and the stellar systems 
could not continue to operate by the laws of Newton and Laplace to the end of 
time. 3 

Laplace presented a copy of Mechanique Celeste to Napoleon, who, after read- 
ing the book, took Laplace to task for not including God in his scheme: “You have 
written this huge book on the system of the world without once mentioning the au- 
thor of the universe.’ “Sire,” Laplace retorted, “I had no need of that hypothesis.” 
Napoleon was not amused, and when he reported this reply to Lagrange, the latter 
remarked, Ah, but that is a fine hypothesis. It explains so many things.” 4 

Napoleon, following his policy of honoring and promoting scientists, made 
Laplace the minister of the interior. To Napoleon’s dismay, he found the great 
mathematician-astronomer bringing “the spirit of infinitesimals” into administra- 
tion, and so had Laplace transferred hastily to the senate. 


Oliver Heaviside (1850-1925) 

Although Laplace published his transform method to solve differential equa- 
tions in 1779, the method did not catch on until a century later. It was rediscovered 
independently in a rather awkward form by an eccentric British engineer, Oliver 
Heaviside (1850-1925), one of the tragic figures in the history of electrical engi- 
neering. Despite his prolific contributions to electrical engineering, he was severely 
criticized during his lifetime, and was neglected later to the point that hardly a 
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P.S. de Laplace (left) and Oliver Heaviside (right). 


textbook today mentions his name or contributions. With the passage of time, 
Heaviside becomes more distant, although his studies had a major impact on many 
aspects of modern electrical engineering. It was Heaviside who made transatlantic 
communication possible by inventing cable loading, but no one ever mentions him 
as a pioneer or an innovator in telephony. It was Heaviside who suggested the use 
of inductive cable loading, but the credit is given to M. Pupin, who actually built 
the first loading coil. In addition, Heaviside was 5 

• The first to find a solution to the distortionless transmission line; 

• The innovator of lowpass filters; 

• The first to write Maxwell’s equations in modern form; 

• The co-discoverer of rate energy transfer by an electromagnetic field; 

• An early champion of the now-common phasor analysis; 

• An important contributor to the development of vector analysis. In fact, he 
essentially created the subject independently of Gibbs 6 ; 

• An originator of the use of operational mathematics used to solve linear 
integro-differential equations, which eventually led to rediscovery of the ignored 
Laplace transform; 

• The first to theorize (along with Kennedy of Harvard) that a conducting layer 
(the Kennelly-Heaviside layer) of atmosphere exists, which allows radio waves 
to follow earth’s curvature instead of traveling off into space in a straight line; 

• The first to posit that an electrical charge would increase in mass as its 
velocity increases; an anticipation of an aspect of Einstein’s special theory of 
relativity. 7 He also forecast the possibility of superconductivity. 

Heaviside was a self-made, self-educated man with only an elementary school 
education, who eventually became a pragmatically successful mathematical physi- 
cist. He began his career as a telegrapher, but increasing deafness forced him to 
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retire at the age of 24. He then devoted himself to the study of electricity. His 
creative work was disdained by many professional mathematicians because of his 
lack of formal education and his unorthodox methods. 

Heaviside’s misfortune was that he was criticized both by mathematicians, who 
faulted him for lack of rigor, and by men of practice, who faulted him for using too 
much mathematics and thereby confusing students. Many mathematicians, trying 
to find solutions to the distortionless transmission line, failed because no rigorous 
tools were available at the time. Heaviside succeeded because he used mathematics 
not with rigor, but with insight and intuition. Using his much-maligned operational 
method, Heaviside successfully attacked problems that the rigid mathematicians 
could not solve: problems such as the flow of heat in a body of spatially varying 
conductivity. Heaviside brilliantly used this method in 1895 to demonstrate a fatal 
flaw in Lord Kelvin’s determination of the geological age of the earth by secular 
cooling, he used the same flow of heat theory as for his cable analysis. Yet the 
mathematicians of the Royal Society remained unmoved and were not the least 
impressed by the fact that Heaviside had found the answer to problems no one 
else could solve. Many mathematicians who examined his work dismissed it with 
contempt, asserting that his methods were either complete nonsense or a rehash of 
already-known ideas. 5 

Sir William Preece, the chief engineer of the British Post Office, a savage critic 
of Heaviside, ridiculed Heaviside’s work as too theoretical and, therefore, leading to 
faulty conclusions. Heaviside’s work on transmission lines and loading was dismissed 
by the British Post Office; this work might have remained hidden, had not Lord 
Kelvin himself publicly expressed admiration for it. 5 

Heaviside’s operational calculus may be formally inaccurate, but in fact it antic- 
ipated the current operational methods developed in more recent years. 8 Although 
his method was not fully understood, it provided correct results. When Heaviside 
was attacked for the vague meaning of his operational calculus, his pragmatic reply 
was, “Shall I refuse my dinner because I do not fully understand the process of 
digestion?” 

Heaviside lived as a bachelor hermit, often in near-squalid conditions, and died 
largely unnoticed, in poverty. His life demonstrates the arrogance and snobbish- 
ness of the intellectual establishment, which does not respect creativity unless it is 
presented in the strict language of the establishment. 


6.2 Some Properties of the Laplace Transform 


Because it is a generalized form of the Fourier transform, we expect the Laplace 
transform to have properties similar to those of the Fourier transform. However, 
we are discussing here mainly the properties of the unilateral Laplace transform! 
and they differ somewhat from those of the Fourier transform (which is a bilateral 
transform). 

Properties of the Laplace transform are useful not only in the derivation of the 
Laplace transform of functions but also in the solutions of linear integro-differential 
equations. A glance at Eqs. (6.8a) and (6.8b) shows that, as in the case of the Fourier 
transform, there is a certain measure of symmetry in going from /(<) to F(s), and 
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vice versa. This symmetry or duality is also carried over to the properties of the 
Laplace transform. This fact will be evident in the following development. 

1. Time Shifting 

This property states that if 

f(t) <=> F(s) 

then for to > 0 

f(t - t 0 ) 4=4- F(s)e~ st ° (6.29a) 

Observe that f(t) starts at f = 0, and, therefore, f(t - to) starts at t = to- This 
fact is implicit, but is not explicitly indicated in Eq. (6.29a). This often leads to 
inadvertent errors. To avoid such a pitfall, we should restate the property as follows: 
If 

f(t)u(t) 4=i> F(s ) 

then 

f(t - to)u(t - to) 4=4 F(s)e -Sf ° t 0 > 0 (6.29b) 

Proof: 

rOO 

C[f(t-to)u(t-to)]= / f(t - to)u(t - fo)e -st dt 

Jo 

Setting t - to = x, we obtain 

£ [/(t - t 0 )u(t - t 0 )] = f f {x)u{x)e~^ x+t °' > dx 
J-t o 

Because u(x) — 0 for x < 0 and u(x) = 1 for x > 0, the limits of integration are 
from 0 to oo. Thus 


rOO 

’ [/(* - to)u(t - <o)] = / f(x)e~ s( ‘ x+t °' ) dx 

Jo 

/•OO 

_ g-st° / f{x)e~ 3X dx 

Jo 


= F(s)e- 


Note that f(t — to)u(t - to) is the signal f(t)u(t) delayed by to seconds. The time- 
shifting property states that delaying a signal by to seconds amounts to multiplying 
its transform e~ sto . 

This property of the unilateral Laplace transform holds only for positive to 
because if to were negative, the signal f(t — to)u(t — to) would not be causal. 

We can readily verify this property in Exercise E6.1. If the signal in Fig. 6.3a 
is /(t)u(t), then the signal in Fig. 6.3b is f(t - 2 )u(f - 2). The Laplace transform 
for the pulse in Fig. 6.3a is -(1 - e _2s ). Therefore, the Laplace transform for the 
pulse in Fig. 6.3b is j(l - e~ 2s )e~ 2s . 
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Fig, 6.5 Finding a mathematical description of a function f(t) in Fig. 6.5a. 

The time-shifting property proves very convenient in finding the Laplace 
transform of functions with different descriptions over different intervals, as the 
following example demonstrates. 

I Example 6.4 

Find the Laplace transform of f(t) depicted in Fig. 6.5a. 

Describing mathematically a function such as the one in Fig. 6.5a is discussed in Sec. 
1.4. The function f(t ) in Fig. 6.5a can be described as a sum of two components shown 
in Fig. 6.5b. The equation for the first component is t - 1 over 1 < t < 2, so that this 
part of fit) can be described by (t - l)(u(t - 1) - u(t - 2)]. The second component can 
be described by u(t - 2) - u(t - 4). Therefore 

fit) = (t — 1) [u(t - 1) - u it - 2)] + [u(« - 2) - uit - 4)] 

= (t - l)u(t - 1) - it - l)u(t - 2) + u(t - 2) - uit - 4) (6.30a) 

The first term on the right-hand side is the signal tu(t) delayed by 1 second. Also, the 
third and fourth terms are the signal u(t) delayed by 2 and 4 seconds respectively. The 
second term, however, cannot be interpreted as a delayed version of any entry in Table 
6.1. For this reason, we rearrange it as 

it - 1 )u(t - 2) = (t - 2 + l)u(t - 2) = it - 2)u(t - 2) + u(t - 2) 

We have now expressed the second term in the desired form as tu(t ) delayed by 2 seconds 
plus uit) delayed by 2 seconds. With this result, Eq. (6.30a) can be expressed as 

fit) = (t- l)u(f - 1) - it - 2)u(f - 2) - uit - 4) (6.30b) 

Application of the time-shifting property to tu(t) 4 => 1/s 2 yields 

(t - l)u(t - 1) 4=*. —^e~’ and (t - 2)u(t - 2) ~e~ 2s 

S g 2 

Also 

u(t) <=> - and u(t — 4) <*=> -e~ 4s 
s s 

Therefore 

Fis) = 4e“‘ _ i e - 2 « - I e - 4 » 

s * s 1 s 


(6.31) 

(6.32) 
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0 1 2 3 t -*■ 

Fig. 6.6 The signal for Exercise E6.3. 


■ Example 6.5 

Find the inverse Laplace transform of 

F(s) = * + 3 +- 5 -£^l 

W (s + l)( S + 2) 

Observe the exponential term e _2 “ in the numerator of F(s), indicating time-delay. In 
such a case we should separate F(s) into terms with and without delay factor, as 


Therefore 


Also, because 


Fi(s) = 
F2(s) = 


(a + l)(s + 2) 

> + !)(* + 2). 

FlW 

F 2 (.)< 

j — 2 j 

$ + 3 

2 

1 

(s + l)(s + 2) 

s + 1 

5 + 2 

5 

5 

5 

(s + l)(s + 2) 

s + 1 

s + 2 


/i(t) = (2e-‘-e- 2t ) u(t) 
h(t) = 5 (e _t — e -2t ) u(t) 

F(s) = fi(s) + Fi(s)e- 2s 


f(t) — fi(t) + fi(t — 2) 

= (2e-* - e -2< ) u(t) + 5 [e" (t - 2) - e' 21 - 25 ] u(t - 2) 


A Exercise E6.3 

Find the Laplace transform of the signal illustrated in Fig. 6.6. 


Answer: (1 - 3e' 2s + 2e" 3s ) V 

A Exercise E6.4 

Find the inverse Laplace transform of 


(«-!)(« + 2 ) 


Answer: je‘ 2 — e 2 (‘ 2 )j u(t — 2) V 
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2. Frequency Shifting 

This property states that if 

f(t) <=>- F(s) 

then 

f(t)e’ ot F(s - s 0 ) (6.33) 

Observe the symmetry (or duality) between this property and the time-shifting 
property (6.29a). 

Proof: 

rOO />oo 

C [/(f)e* ot ] = / f(t)e Sot e~ st dt= /(i)e _<s_3o)t dt = F{s - s 0 ) 

Jo - 70- 


I Example 6.6 

Derive Pair 9a in Table 6.1 from Pair 8a and the frequency-shifting property. 
The Pair 8a is 

cos btu(t) 

From the frequency-shifting property [Eq. (6.33)) with so = -a we obtain 


1 cos btu(t) • 


s + a 

(s + a) 2 + b 2 


A Exercise E6.5 

Derive Pair 6 in Table 6.1 from Pair 3 and the frequency-shifting property. y 

We are now ready to consider the two of the most important properties of the 
Laplace transform: the time-differentiation and time-integration properties. 

3. The Time- Differentiation Property) 

This property states that if 

/(f) F(s) 

then 

■*=> sF (s) - /(0 _ ) (6.34a) 

Repeated application of this property yields 
d 2 f 

~^2 *=* s2p ( s ) - ®/(0 ) - 7(0 ) (6.34b) 

fThe dual of the time-differentiation property is the frequency-differentiation property, which 
states that 

tf(t) ^ --j-F(s) 
as 
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d n f 

<=► sUF M - « n-1 /(0-) - s n-2 /(0~) / (n - 15 (0-) (6.34c) 

where /^(O - ) is d T f/dt r at t = 0~. 

Proof: 



Integrating by parts, we obtain 

' df 00 r°° 

C J- =f(t)e~ st +s / }(t)e- st dt 

, dt \ o- J 0- 

For the Laplace integral to converge (that is for F(s) to exist), it is necessary that 
f(t)e~ st — > 0 as t —* oo for the values of s in the region of convergence for F(s). 
Thus, 

C ft =-ttO~) + sF(°) 


/«) 


dt 


dt 2 


Fig. 6.7 Finding the Laplace transform of a piecewise- linear function using the time- 
differentiation property. 
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B Example 6.7 

th t e . Laplace transform of the signal }(t) in Fig. 6.7a using Table 6.1 and the 
time-differentiation and time-shifting properties of the Laplace transform. 

Figures 6.7b and 6.8c show the first two derivatives of f(t ) . Recall that the derivative 

fee\Tu.27)TTherre tinUity “ "* ^ ° f 1 e<1Ua] the ~ 

f 

df2 = ^(0 ~ 3<5(t — 2) -j- 26(t — 3) 

The Laplace transform of this equation yields 

£ iff) = c ^ ~ ^ ~ 2 ) + 2S ( f ~ 3 )J 

2S2 tl0 n P TZ (6 ' 34 1 the time - shift “g P-P-ty (6.29a) and the 

lacts tnat /(U ) - f(0 ) = 0, and 6(t) <=>■ 1, we obtain 

s 2 F(s) -0-0 = 1- 3e _2s + 2e -3a 

Therefore 

F(s) = i (1 - 3e- 2 * + 2e~ 3s ) 
which confirms the earlier result in Exercise E6.3. ■ 
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Therefore 


F(s) = C TTffW = sG(s) — g(0 ) = sG(s) 
at 


G(s) = 


f /(r)« 

Jo- 


To prove Eq. (6.36), observe that 


[ f( T )dr = [ f (r) dr + f f(r)c 

J — oo J —oo J 0” 


Note that the first term on the right-hand side is a constant. Taking the Laplace 
transform of the above equation and using Eq. (6.35), we obtain 


f f(r)t 

J — OO 


L ao f(r)dT | F(s) 


Scaling 

This property states that if 


then for a > 0 


f{at) *=* \ F 0 


The proof is identical to that of the scaling property of the Fourier transform derived 
in Chapter 4 [Eq. (4.34)]. Note that a is restricted to only positive values because 
if f(t) is causal, then f{at) is anticausal (exists only for t < 0) for negative a, and 
anticausal signals are not permitted in the (unilateral) Laplace transform. 

Recall that f(at) is the signal f(t) time-compressed by the factor a, and F(^) 
is F(s) expanded along the s-scale by the same factor a (see Sec. 1.3-2). The scaling 
property states that time-compression of a signal by a factor a causes expansion of 
its Laplace transform in s-scale by the same factor. Similarly, time-expansion f (t) 
causes compression of F(s) in s-scale by the same factor. 

5. Time Convolution and Frequency Convolution 

This property states that if 

fi(t) •*==> Fi(s) and / 2 (f) F 2 (s) 

then (time convolution property) 

/l(t) * h(t) <*=> Fi(s)F2(s) (6.38) 

and (frequency convolution property) 

fi(t)h(t) •*=> [fii(s) * F 2 (s)} (6.39) 
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The Laplace Transform Properties 


Operation /(f) f(s) 


Addition 

h(t) + f 2 {t) 

Fi(s) + F 2 (s) 

Scalar multiplication 

kf(t) 

kF(s) 

Time differentiation 

4f 

dt 

sF(s)-/(0~) 


fl 

dt 2 

s 2 F(s)-sf(0-)-f(0-) 


dt 3 

s 3 F(s) - s 2 f(0~) - sf( 0 -) - /( 0 - 

Time integration 

/ }{T)dT 

J o- 

-F( s ) 

s 


/ f(r)dr 

J — OO 

1 1 

-F(s) + - f (t) dt 

s s J — oo 

Time shift 

f(t - to)u(t - t 0 ) 

Os 

Ol 

1 

(a 

O 

O 

IV 

o 

Frequency shift 

f(t)e Sot 

F(s - s 0 ) 

Frequency 

differentiation 

~tf(t) 

dF(s) 

ds 

Frequency integration 

m 

t 

poo 

J F(z)dz 

Scaling 

}{at), a > 0 

h(i) 

a \a / 

Time convolution 

fi{t) * f 2 (t) 

Fi(s)F 2 (s) 

Frequency convolution 

h(t)h(t) 

^jF l ( S )*F 2 (s) 

Initial value 

/( o+) 

lim sF(s) (n > m) 

s—*oo ' 

Final value 

/(oo) 

]imsF(s) (poles of sF(s) in LHP) 
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Observe the symmetry (or duality) between the two properties. Proofs of these 
properties are similar to the proofs in Chapter 4 for the Fourier transform. 

Equation (2.48) indicates that H(s), the transfer function of an LTIC system, 
is the Laplace transform of the system’s impulse response h(t)\ that is, 

h(t) <=> H(s) (6.40) 

We can apply the time convolution property to the LTIC input-output relationship 
y(t) = f(t) * h(f) to obtain 

Y(s) = F(s)H(s) (6.41) 

This exact result appeared earlier in Eq. (6.11). 

I Example 6.8 

Using the time convolution property of the Laplace transform, determine 
c(t) — e at u(t) * e bt u(t). 

Fro Eq. (6.38), it follows that 

(s — a)(s — b) a — 6 [s — a s — &] 

The inverse transform of the above equation yields 

c«) = — !-r(e a ‘-e M )u(t) ■ 

a — b 

6.3 Solution of Differential and Integro-Differential Equations 

The time-differentiation property of the Laplace transform has set the stage 
for solving linear differential (or integro-differential) equations with constant co- 
efficients. Because d k y/dt k <=» s fc y(s), the Laplace transform of a differential 
equation is an algebraic equation which can be readily solved for Y(s). Next we 
take the inverse Laplace transform of Y(s) to find the desired solution y(t). The 
following examples demonstrate the Laplace transform procedure for solving linear 
differential equations with constant coefficients. 

■ Example 6.9 

Solve the second-order linear differential equation 

(D 2 + 5D + 6) y(t ) = (D + 1 )/(t) (6.42a) 

if the initial conditions are i/(0~) = 2, y( 0") = 1, and the input f(t) = e _4t u(t). 

The equation is 

§ +t S + *»c <“ 2b > 

Let 

y(t) <=> Y(s) 


Then from Eq. (6.34) 


^. < =>sY(s)-y(0-) = sY(s)-2 


6.3 Solution of Differential and Inteero-Differenti ft .1 Rnnafmno 
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This example demonstrates the ease with which the Laplace transform can 
solve linear differential equations with constant coefficients. The method is general 
and can solve a linear differential equation with constant coefficients of any order. 

Zero-Input and Zero-State Components of Response 

The Laplace transform method gives the total response, which includes zero- 
mput and zero-state components. It is possible to separate the two components if 
we so desire. The initial condition terms in the response give rise to the zero-input 
response. For instance, in Example 6.9, the terms arising due to initial conditions 
y(0 ) - 2 and y(0 ) = 1 in Eq. (6.43a) generate the zero-input response. These 
initial condition terms are -(2s + 11), as seen in Eq. (6.43b). The terms on the 
right-hand side are exclusively due to the input. Equation (6.43b) is reproduced 
below with the proper labeling of the terms. 
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(s 2 + 5s + 6) Y(s) - (2s + 11) = 


so that 


(s 2 + 5s + 6)E(s) 


(2s + 11) 


initial condition terms 


3 + 1 

s + 4 


input terms 


Therefore 


2s + 11 

+ 

s + X 

s 2 + 5s + 6 

(s + 4)(s 2 + 5s + 6) 

zero- input component 

zero- state component 

'7 5 

+ 

'-1/2 2 3/2 ' 

s + 2 s + 3 

3 + 2 5+3 5 + 4 


Taking the inverse transform of this equation yields 

y(t) = (7e~ 24 - 5e~ 34 ) u(t) + (-i<r 24 + 2e ~ 3 ‘ ~ § e_4 ‘) “(0 

^ -> v 

zero-input response zero-state response 


Comments on Initial Conditions at 0 and at 0 + 

The initial conditions in Example 6.9 are y(0~) = 2 and y(0 - ) = 1. If we let 
t = 0 in the total response in Eq. (6.44), we find y(0) = 2 and y (0) = 2, which 
is at odds with the given initial conditions. Why? The reason is that the initial 
conditions are given at t = 0~ (just before the input is applied), when only the zero- 
input response is present. The zero-state response is the result of the input /(f) 
applied at t = 0. Hence, this component does not exist at t = 0 - . Consequently, 
the initial conditions at f = 0" are satisfied by the zero-input response, not by the 
total response. We can readily verify in this example that the zero-input response 
does indeed satisfy the given initial conditions at f = 0“. It is the total response 
that satisfies the initial conditions at t = 0 + , which are generally different from the 
initial conditions at 0“. 

There also exists a C + version of the Laplace transform, which uses the initial 
conditions at t = 0 + rather than at 0“ (as in our present £_ version). The C + 
version, which was in vogue till the early sixties, is identical to the £_ version 
except the limits of Laplace integral [Eq. (6.18)] are from 0 + to oo. Hence, by 
definition, the origin t = 0 is excluded from the domain. This version, still used in 
some math books, has some serious difficulties. For instance, the Laplace transform 
of 1 5(f) is zero because S(t ) = 0 for t > 0 + . Moreover, this approach is practically 
useless in the theoretical study of linear systems because the response obtained by 
this method cannot be separated into zero-input and zero-state components. As 
we know, the zero-state component represents the system response as an explicit 
function of the input, and without knowing this component, it is not possible to 
assess the effect of the input on the system response. The £+ version can separate 
the response in terms of the natural and the forced components, which are not 
as interesting as the zero-input and the zero-state components. Note that we can 
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always determine the natural and the forced components from the zero-input and 
the zero-state components (see Eq. (2.51b), but the converse is not true. Because 
of these and some other problems, electrical engineers (wisely) started discarding . 
the C + version in the early sixties. 

It is interesting to note the time domain duals of these two Laplace versions. 
The classical method is the dual of the £ + method, and the convolution (zero- 
input/zero-state) method is the dual of the £_ method. The first pair uses the 
initial conditions at 0 + , and the second pair uses those at f = 0". The first pair 
(the classical method and the £+ version) is useless in the theoretical study of linear 
system analysis. It was no coincidence that the £_ version was adopted immediately 
after the introduction of the state-space analysis (which uses zero-input/zero-state 
separation of the input) to the electrical engineering community. 

A Exercise E6.6 
Solve 

g +4 | +3s , (t) = 2 | +/(t ) 

for the input /(t) = u(t). The initial conditions are y(0 _ ) = 1 and y( 0~) = 2. 

Answer: y(t) = 1(1 + 9 e -‘ - 7e~ 3t )u(t) y 



Fig. 0.8 Analysis of a network with a switching action (Example 6.10). 


1 Example 6.10 

In the circuit of Fig. 6.8a, the switch is in the closed position for a long time before 
t = 0, when it is opened instantaneously. Find the inductor current y(t) for t > 0. 

When the switch is in the closed position (for a long time), the inductor current is 

2 amps and the capacitor voltage is 10 volts. When the switch is opened, the circuit is 
equivalent to that depicted in Fig. 6.8b, with the initial inductor current y(0“) = 2 and 
the initial capacitor voltage uc(0 - ) = 10. The input voltage is 10 volts, starting at t = 0, 
and, therefore, can be represented by 10u(t). 


6 Continuous-Time System Analysis Using the Laplace Transform^ 
The loop equation of the circuit in Fig. 6.8b is 


• + 2 y(t) + 5 / y(r) dr = 10u(t) 


and [see Eq. (6.36)] 


y(t) •*=*> Y(s) 


■ sY(s) -y ( 0 ) = sY(s) - 2 




Because y{t) is the capacitor current, the integral kM dr is qc( 0 ), the capacitor 
charge at t = 0“, which is given by C times the capacitor voltage at t = 0". Therefore 


y(r)dr = qc ( 0 ) = Ct>c(0 ) = -(10) -2 


From Eq. (6.46c) it follows that 


y {T)dT< =>X^l + l 


Taking the Laplace transform of Eq. (6.45) and using Eqs. (6.46a), (6.46b), and (6.48), we 

° btam . . 5Y(s) 10 10 

sY (s) - 2 + 2 y (s) H — + — - ~ 


-1 TW = : 

S 


YW= S> + 2 —5 

To find the inverse Laplace transform of Y(s), we use Pair 10c (Table 6.1) with values 
A = 2, B = 0, a = 1, and c = 5. This yields 


= ,/f = VE, b= sjc-a? = 2 and « = tan _1 (|) = 26.6° 


Therefore 


y(t) = yfEe~* cos (2t + 26.6°)u (t) 


This response is shown in Fig. 6.8c. I 

6.3-1 Zero-State Response: The Transfer Function of an LTIC System 

Consider an nth-order LTIC system specified by the equation 


Q{D)y(t) = P(D)f(t) 


I 
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or 

C® d" a n-i D n 1 + ■ ■ • + aiD + ao)y(t) = 

(b n D + b n _iD n 1 + ■ • • + brD + bo)/(t) (6.49) 

We shaft now find the general expression for the zero-state response of an LTIC 
system, Zero-state response j/(t), by definition, is the system response to an input 
when the system is initially relaxed (in zero state). Therefore, y(t) satisfies the 
system equation (6.49) with zero initial conditions 

y(0~) = 1/(0") = y((T) = • ■ • = (0~ ) = 0 

Moreover, the input f(t) is causal, so that 

/( 0~) = /(0-) = /(0“) = • • • = /f n-1 )(o-) = 0 

Let 

y(t) <^=s- Y(s) and /(f) «=*. F(s) 

Because of zero initial conditions 

° T V (0 = y(t) <=> * r T(s) 

Dkf{t) = £ /(t) *=* sk ^ s ) 

Therefore, the Laplace transform of Eq. (6.49) yields 

(s n + a n _is n_1 + • •• + ai s + a 0 ) Y{s) = (b n s n + b n _ 1 s n - 1 + • • • + bis + 6 0 ) F(s) 
or 



We have already derived this result twice using other approaches. We now have an 
alternate interpretation (or an alternate definition) for the transfer function H(s). 
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It is the ratio of T(s) to F(s) when all the initial conditions are zero (when the 
system is in zero state). Thus 


HM 'W) 


£ [zero-state response] 
£ [input] 


We have shown that Y(s), the Laplace transform of the zero-state response y(t), 
is the product of F(s ) and H (s). where F{s) is the Laplace transform of the input 
f(t) and H (s) is the system transfer function [relating the particular output y(t) to 
the input /(*)]. Observe that the denominator of H{s) is Q(s), the characteristic 
polynomial of the system. Therefore, the poles of ff(s) are the characteristic roots 
of the system. Consequently, the system stability criterion can be stated in terms 
of the poles of the transfer function of a system, as follows: 

1 . An LTIC system is asymptotically stable if and only if all the poles of its transfer 
function H (s) are in the LHP. The poles may be repeated or unrepeated. 

2. An LTIC system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one pole of H (s) is in the RHP; (ii) there are 
repeated poles of H(s) on the imaginary axis. 

3. An LTIC system is marginally stable if and only if there are no poles of H(s) 
in the RHP, and there are some unrepeated poles on the imaginary axis. 

We can now represent the transformed version of the system, as depicted in 
Fig. 6.9. The input F(s) is the Laplace transform of f(t), and the output T(s) is 
the Laplace transform of (the zero-input response) y(t). The system is described 
by the transfer function H(s). The output Y (s) is the product F(s)H(s). 

The result T(s) = H(s)F(s) greatly facilitates derivation of the system re- 
sponse to a given input. We shall demonstrate this assertion this by an example. 

M Example 6.11 

Find the response y(t) of an LTIC system described by the equation 


g + ,| +w , 
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Y(s) = F{s)H(s) 



Fig. 6.9 The transformed representation of an LTIC system. 

if the input f(t) = 3 e~ 5t u(t) and all the initial conditions are zero; that is, the system is 
in zero-state. 

The system equation is 

(D 2 +5D + 6) y(t) = (£> + !) f(t) 


Therefore 


R(s) = 


P(s) _ s + 1 
Q(s) s 2 + 5s + 6 


F(s) = £ [3 e~ 5t u(t)] 


Y(s) F(s)H(s) (s + 5) ( (s , + l + 6) 
3(s + l) 

(s + 5 )(s + 2)(s + 3) 

-2 1_ 3 

s + 5 s + 2 5+3 


The inverse Laplace transform of this equation is 

y(t) = (— 2e~ 5t - e~ 2t + 3e -3t ) u(t) ■ 

H Example 6.12 

Show that the transfer function of 

(a) an ideal delay of T seconds is e“ , 

(b) an ideal differentiator is s; 

(c) an ideal integrator is 1/s. 

(a) Ideal Delay 

For an ideal delay of T seconds, the input f(t) and output y(t) are related by 
y(t) = f(t-T) 


Y (s) = F(s)e~ sT [see Eq. (6.29a)] 


Therefore 




6.4 Analysis of Electrical Networks: The Transformed Network 

Example 6.10 shows how electrical networks may be analyzed by writing the 
integro-differential equation (s) of the system and then solving these equations by 
the Laplace transform. We now show that it is also possible to analyze electrical 
networks directly without having to write the integro-differential equations. This 
procedure is considerably simpler because it permits us to treat an electrical network 
as if it were a resistive network. For this purpose, we need to represent a network 
in the “frequency domain” where all the voltages and currents are represented by 
their Laplace transforms. 

For the sake of simplicity, let us first discuss the case with zero initial conditions. 
If v (t) and i(t) are the voltage across and the current through an inductor of L 
henries, then 

di 

The Laplace transform of this equation (assuming zero initial current) is 


V(s) = Lsl(s) 
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Similarly, for a capacitor of C farads, the voltage-current relationship is i(t) = 
and its Laplace transform, assuming zero initial capacitor voltage, yields I(s) = 
CsV (s); that is, 

V U = lk I{s) 

For a resistor of R ohms, the voltage-current relationship is v(t) = Ri(t), and its 
Laplace transform is 

V(s) = RI(s) 

Thus, in the “frequency domain,” the voltage-current relationships of an inductor 
and a capacitor are algebraic; these elements behave like resistors of “resistance” 
Ls and l/Cs, respectively. The generalized “resistance” of an element is called its 
impedance and is given by the ratio V (s)/I(s) for the element (under zero initial 
conditions). The impedances of a resistor of R ohms, an inductor of L henries, and 
a capacitance of C farads are R. Ls , and l/Cs, respectively. 

Also, the interconnection constraints (Kirchhoff’s laws) remain valid for volt- 
ages and currents in the frequency domain. To demonstrate this point, let vj(t) 
0=1, 2, . . . , k) be the voltages across k elements in a loop and let ij(t) (j = 1, 2, 
. . . , m) be the j currents entering a node. Then 

k m 

J^Vj(t)-0 and ^L,(t) = 0 (6.57) 

j=l j= l 

Now if 

vj(t) <=> V'j(s) and ij(t) <=> I,{s) 

then 

k m 

^F,(s) = ° and ^/,,(s) = 0 (6.58) 

i = i j=i 

This result shows that if we represent all the voltages and currents in an electrical 
network by their Laplace transforms, we can treat the network as if it consisted 
of the “resistances” R, Ls and l/Cs corresponding to a resistor R, an inductor 
L, and a capacitor C, respectively. The system equations (loop or node) are now 
algebraic. Moreover, the simplification techniques that have been developed for 
resistive circuits — equivalent series and parallel impedances, voltage and current 
divider rules, Thevenin and Norton theorems — can be applied to general electrical 
networks. The following examples demonstrate these concepts. 

I Example 6.13 

Find the loop current i(t) in the circuit shown in Fig. 6.10a if all the initial conditions 
are zero. 

In the first step, we represent the circuit in the frequency domain, as illustrated in 
Fig. 6.10b. All the voltages and currents are represented by their Laplace transforms. The 
voltage 10u(t) is represented by 10/s and the (unknown) current i(t) is represented by 
its Laplace transform /(s). All the circuit elements are represented by their respective 
impedances. The inductor of 1 henry is represented by s, the capacitor of 1/2 farad is 
represented by 2/s, and the resistor of 3 ohms is represented by 3. We now consider the 
frequency-domain representation of voltages and currents. The voltage across any element 
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1 H 3£1 




Fig. 6.10 A circuit and its transformed version (Example 6.13). 

is J(s) times its impedance. Therefore, the total voltage drop in the loop is I(s) times the 
total loop impedance, and it must be equal to V(s), (transform of) the input voltage. The 
total impedance in the loop is 

, „ 2 s 2 + 3s + 2 

Z{s) — s + 3 H — — 

s s 

The input “voltage” is V(s) = 10/s. Therefore, the “loop current” J(s) is 

. U(s) ~T = 10 = 10 = _1£ 10_ 

(S> Z(s) s 2 + 3s + 2 (s + l)(s + 2) s + 1 s + 2 

The inverse transform of this equation yields the desired result: 

i{t) = 10(e -t - e~ 2 ‘)u(t) ■ 


Initial Condition Generators 

The above discussion, where we assumed zero initial conditions, can be readily 
extended to the case of nonzero initial conditions because the initial condition in a 
capacitor or an inductor can be represented by an equivalent source. We now show 
that a capacitor C with an initial voltage u(0) (Fig. 6.11a) can be represented in 
the frequency domain by an uncharged capacitor of impedance l/Cs in series with 
a voltage source of value v(0)/s (Fig. 6.11b) or as the same uncharged capacitor in 
parallel with a current source of value Cu(0) (Fig. 6.11c). Similarly, an inductor L 
with an initial current i(0) (Fig. 6. lid) can be represented in the frequency domain 
by an inductor of impedance Ls in series with a voltage source of value Li{ 0) (Fig. 
6.1 le) or by the same inductor in parallel with a current source of value i(0)/s (Fig. 
6. Ilf). To prove this point, consider the terminal relationship of the capacitor in 
Fig. 6.11a 

. , du 
i(t) = C dt 

The Laplace transform of this equation yields 


I(s) = C[sF(s) - u(0)] 



fin th e time domain, a charged capacitor C with initial voltage v(0) can be represented as the 

somyCvmWtrsfrS'faH ‘ D “T 'TV V °J tage Source ^M*). or in P mallei with a current 
° Slmi . la , rl >'’ an eductor L with initial current i(0) can be represented by the same 

source°(0)u(t) ZerO CU1Tent ^ Seri6S Wi ‘ h a V °’ tage SOUrce Li ^ 6 ^ or with a P aralI el current 
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v(0 v(0) V(j) 


Fig. 6.11 Initial condition generators for a capacitor and an inductor. 

This equation can be rearranged as 

!/(,)- T,(.) + rffl (6.59.) 

Observe that F(s) is the voltage (in the frequency domain) across the charged 
capacitor and I(s)/Cs is the voltage across the same capacitor without any charge 
therefore, the above equation shows that the charged capacitor can be represented 
by the same capacitor (uncharged) in series with a voltage source of value u(0)/s 
as depicted in Fig. 6.11b. Equation (6.59a) can also be rearranged as 

= 57 + CT(0)] (6.59b) 

This equation shows that the charged capacitor voltage V(s) is equal to the un- 
charged capacitor voltage caused by a current I(s) + Cv( 0). This result is re- 

flected precisely in Fig. 6.11c, where the current through the uncharged capacitor 
is I(s) + Cu(0).f 
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For the inductor in Fig. 6. lid, the terminal equation is 

. . „ di 

v(t) = L it 


V(a) = L[sI(,)-i( 0)] 
= Lsl(s) — Li{ 0) 


= Ls /(« 


(6.60b) 


We can verify that Fig. 6. lie satisfies Eq. (6.60a) and that Fig. 6. Ilf satisfies Eq 
(6.60b). 


y<0’) = 2 


m r 



Fig. 6.12 A circuit and its transformed version with initial condition generators (Example 

6.12). 


Let us rework Example 6.10 using these ideas. Figure 6.12a shows the circuit 
in Fig. 6.8b with the initial conditions y(0) = 2 and vc(0) = 10. Figure 6.12b 
shows the frequency-domain representation (transformed circuit) of the circuit in 
Fig. 6.12a. The resistor is represented by its impedance 2; the inductor with initial 
current of 2 amps is represented according to the arrangement in Fig. 6.11e with 
a series voltage source Ly( 0) = 2. The capacitor with initial voltage of 10 volts 
is represented according to the arrangement in Fig. 6.11b with a series voltage 
source v(0 )/s = 10/s. Note that the impedance of the inductor is s and that of the 
capacitor is 5/s. The input of 10u(t) is represented by its Laplace transform 10/s. 


The total voltage in the loop is — + 2 • 
(s + 2 + j). Therefore 


= 2, and the loop impedance is 


y(s) = 


s + 2 + f 
2s 

s 2 + 2s + 5 


which confirms our earlier result in Example 6.10. 
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B Example 6.14 

-r ; aL t f - 

as ° m g ' ’ the l00P equati0ns can be written directl y in the frequency domain 


y»(») 

s 


+ i(Ki(s)-K 2 (s)] = 


4 

s 


-| y ' i (*) + g^W + |y2(s) = 2 



Application of Cramer’s rule to this equation yields 


^(s) = 


24(s + 2) 
s 2 + 7s+ 12 


24(s + 2) 

(s + 3 )(s + 4) 


-24 48 

s + 3 s + 4 
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! + 48e~ 4 ‘) u(t) 


Similarly, we obtain 


4 (s + 7) 
s 2 + 7s + 12 


1/2 (i) = (l6e 3t — 12e 4t ) u(t) 

We also could have computed Vi(s) and >2(s) using Thevenin’s theorem by replacing 
the circuit to the right of the capacitor (right of terminals ab) with its Thevenin equivalent, 
as shown in Fig. 6.13c. Figure 6.13b shows that the Thevenin impedance Z(s) and the 
Thevenin source V(s) are: 


Z(s) = -f 


5 o ~ 4 
; + 1 5s + 12 


According to Fig. 6.13c, the current Yi(s) is given by 

,() ~ l + ZM 

= 24 (s + 2) 

s 2 + 7s + 12 

a conclusion which confirms the earlier result. We may determine K2(s) in a similar 


■ Example 6.15 

The switch in the circuit in Fig. 6.14a is at position a for a long time before t = 0, 
when it is moved instantaneously to position 6. Determine the current yi{t) and the output 
voltage vo (t) for t > 0. 

Just before switching, the values of the loop currents are 2 and 1, respectively, that 
is; yi(CT) = 2 and 3/2(0") = 1. 

The equivalent circuits for two types of inductive couplings are illustrated in Figs. 
6.14b and 6.14c. For our situation, the circuit in Fig. 6.14c applies. Fig. 6.14d shows the 
transformed version of the circuit in Fig. 6.14a after switching. Note that the inductors 
Li + M, L '2 + Af , and —M are 3,4, and —1 henries with impedances 3s, 4s, and — s 
respectively. The initial condition voltages in the three branches are (L 1 + M)y i(0) = 6, 
(L 2 + Af) 3/2(0) = 4, and -Af[j/i(0) - 3/2(0)] = -1, respectively. The two loop equations of 
the circuit aref 

fThe time domain equations (loop equations) are 

+ (Hi + Rl)y\(t) - R 2 y 2 (0 + = 10u(t) 

at at 

- R 2 yi(t) + L 2 ^ + (R 2 + R 3 )y 2 (t) = 0 
at at 

The Laplace transform of these equations yields Eq. (6.61). 






A Exercise E6.8 

For the RLC circuit in Fig. 6.15, the input is switched on at t = 0. The initial conditions 
are t/(0 — ) = 2 amps and vc(0) = 50 volts. Find the loop current y(t ) and the capacitor voltage 
v c {t) for t > 0. 

Answer: 

y(t) = 10V2e-‘ cos (2t + 81.8°)u(f), v c (t) = (24 + 31.62e-* cos (2 1 - 34.7°))u(t) y 



Fig. 6.15 Circuit for Exercise E6.8. 


6.4-1 Analysis of Active Circuits 

Although we have considered examples of only passive networks so far, the 
circuit analysis procedure using the Laplace transform is also applicable to active 
circuits. All that is needed is to replace the active elements with their mathematical 
models (or equivalent circuits) and proceed as before. 

The operational amplifier (depicted by the triangular symbol in Fig. 6.16a) 
is a well-known element in modern electronic circuits. The terminals with the 
positive and the negative signs correspond to noninverting and inverting terminals, 
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(c) (d) 


Fig. 6.16 Operational amplifier and its equivalent circuit. 

respectively. This means that the polarity of the output voltage v 2 is the same as 
that of the input voltage at the terminal marked by the positive sign (noninverting). 
The opposite is true for the inverting terminal, marked by the negative sign. 

Figure 6.16b shows the model (equivalent circuit) of the operational amplifier 
(°P amp) in Fig. 6.16a. A typical op amp has a very large gain. The output voltage 
v 2 = -Aiq, where A is typically 10 5 to 10 6 . The input impedance is very high 
(typically 10 6 0 for BJT to 10 12 H for Bi-FET), and the output impedance is very 
low (50 to 100 ft). For most applications, we are justified in assuming the gain A 
and the input impedance to be infinite and the output impedance to be zero. For 
this reason we see an ideal voltage source at the output. 

Consider now the operational amplifier with resistors R a and Rb connected, as 
shown in Fig. 6.16c. This configuration is known as the noninverting amplifier. 
Observe that the input polarities in this configuration are inverted when compared 
to those in Fig. 6.16a. We now show that the output voltage v 2 and the input 
voltage v, in this case are related by 

v 2 = Kv i K = 1 + (6.62) 

First, we recognize that because the input impedance and the gain of the operational 
amplifier approach infinity, the input current i x and the input voltage v x in Fig. 
6.16c must approach zero. The dependent source in this case is Av x instead of 
-Av x because of the input polarity inversion. The dependent source Av x (see Fig. 
6.16b) at the output will generate current i a , as illustrated in Fig. 6.16c. Now 


V2 = (Rb + R a )i, 
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Therefore 


u r — Vx T Ra'io 
— R^io 


V2 _ Rb + Ra 1 Rb J, 

V\ Ra Ra 


v 2 (t) = Kvi(t) 

The equivalent circuit of the noninverting amplifier is depicted in Fig. 6.16d. 


■ Example 6.16 

The circuit in Fig. 6.17a is called the Sallen-Key circuit, which is frequently used 
in filter design. Find the transfer function H(s ) relating the output voltage u„(t) to the 
input voltage Vi (t). 

We are required to find 

H(s) = 

{s) V,(.) 

assuming all initial conditions to be zero. 

Figure 6.17b shows the transformed version of the circuit in Fig. 6.17a. The nonin- 
verting amplifier is replaced by its equivalent circuit. All the voltages are replaced by their 
Laplace transforms and all the circuit elements are shown by their impedances. All the 
initial conditions are assumed to be zero, as required for determining H(s). 

We shall use node analysis to derive the result. There are two unknown node voltages, 
F a (s) and Vj(s), requiring two node equations. 

At node a, //*,(«), the current in Ri (leaving the node a), is [V a (s) - Vi(s)]/Ai. Sim- 
ilarly, /r 2 (s), the current in R 2 (leaving the node a), is [F n (s) - Vb(a)J/i ?2 and ic,(s), the 
current in capacitor Ci (leaving the node a), is [Va(s) - V 0 (s)]Cis = [V a (s) - AVi(s)]Cis. 
The sum of all the three currents is zero. Therefore 

Vh(s) - Vi ( f ) + Va(s) - V, ,(s) + _ x Vi ( a )] c lS = 0 

Ri R 2 

or 

(bt + i c ' 1 ) v - l '> - (£ + Ka ’) «•> - i VM |6S3 *> 

Similarly, the node equation at node b yields 


Vb(s) - Va(s) 


+ C2sVb(s) = 0 




The two node equations (6.63a) and (6.63b) in two unknown node voltages V a (s) and 14(s) 
can be expressed in matrix form as 


G\ + G2 + C\s — (G2 + KCis) Va(s) 
— G2 (G2 + C2-S) V&(s) 


GiVi{s) 
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Now 

Therefore 


V„(s) = KVb(s) 


H(s) 


_ V^£) Ms) = 

Vi(s) Vi{s) 


Kuo 2 

s 2 + 2as + uo 2 



6.4-2 Initial and Final Values 

In certain applications, it is desirable to know the values of / (t) as t — > 0 and 
t — > oo [initial and final values of fit)] from the knowledge of its Laplace transform 
F{s). Initial and final value theorems provide such information. 

The initial value theorem states that if fit) and its derivative df/dt are 
both Laplace transformable, then 

/(0 + ) = lim sF(s) (6.67) 

s— *oo 

provided that the limit on the right-hand side of Eq. (6.67) exists. 

The final value theorem states that if both /(t) and df/dt are Laplace 
transformable, then 

lim /(t) = lim sF(s) (6.68) 

t— » oo s — »0 

provided that sF(s) has no poles in the RHP or on the imaginary axis. To prove 
these theorems, we use Eq. (6.34a) 

.F(.)-/(o-)=jrf‘“'‘* 



= /(0 + )-/(0-) + £°fe--dt 


Therefore 

sF(s) = f( 0+) + £%e-«dt 

and 


/•OO 

lim sF(s) = /(0 + ) + lim / 

a —* oo s— »oo J q+ 


d± e - st 

dt 


dt 


= /(0+)+ / o ;s dt 

= /( o + ) 


6.5 Block Diagrams 
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Comment: The initial value theorem should be applied only if F(s) is strictly 
proper (m < n), because for m > n, lim^oo sF{s) does not exist, and the theorem 
does not apply. 

To prove the final value theorem, we let s -> 0 in Eq. (6.34a) to obtain 


lim [sF(s) - /CO-)] = lim [°° fe~ st dt = f°° dt 

s -° -o J Q _ dt J 0 . dt 

OO 

= f(t) = lim f{t) - /( 0~) 

o- 

a deduction which leads to the desired result (6.68) 

Comment: The final value theorem applies only if the poles of sF(s ) are in 
the LHP. If there is a pole on the imaginary axis, then lim s _ 0 sF(s) does not exist. 
If there is a pole in the RHP, lim,^ fit) does not exist. 

I Example 6.17 

Determine the initial and final values of y(t) if its Laplace transform Y (s) is given by 


y( s ) = 


10(2s + 3) 
s(s 2 + 2s + 5) 


Equations (6.67) and (6.68) yield 


S/(0 + ) = lim sT(s)= lim 


10(2s + 3) 


' s— oo ' ’ j—i, (s 2 + 2s + 5) 

y(oo) = lim sT(s) = lim t \°^ + ^ , = 6 
»_o s _o (s 2 + 2s + 5) 


6.5 Block Diagrams 

Large systems may consist of an enormous number of components or elements. 
Analyzing such systems all at once could be next to impossible. Anyone who has 
seen the circuit diagram of a radio or a TV receiver can appreciate this fact. In such 
cases, it is convenient to represent a system by suitably interconnected subsystems, 
each of which can be readily analyzed. Each subsystem can be characterized in 
terms of its input-output relationships. A linear (sub)system can be characterized 
by its transfer function H[s). Figure 6.18a shows a block diagram of a system with 
a transfer function H (s) and its input and output represented by their frequency 
domain descriptions F(s) and Y (s) respectively. 

Subsystems may be interconnected by using three elementary types of inter- 
connections (Figs. 6.18b, 6.18c, 6.18d): cascade, parallel, and feedback. When two 
transfer functions appear in cascade, as depicted in Fig. 6,18b, the transfer function 
of the overall system is the product of the two transfer functions. This conclusion 
follows from the fact that in Fig. 6.18b 


1(f) 

F(s) 


W{s) Y is) 
F{s) W is) 


= H 1 (s)H 2 (s) 


This result can be extended to any number of transfer functions in cascade. 
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Similarly, when two transfer functions, Hi(s) and H 2 ( 5 ), appear in parallel, as 
illustrated in Fig. 6.18c, the overall transfer function is given by Hi (s) + H 2 {s), the 
sum of the two transfer functions. The proof is trivial. This result can be extended 
to any number of systems in parallel. 

When the output is fed back to the input, as shown in Fig. 6.18d, the overall 
transfer function Y ( s)/F(s ) can be computed as follows. The inputs to the summer 
are F(s) and —H(s)Y(s). Therefore, E(s), the output of the summer, is 

E(s) = F(s)-H(s)Y(s) 

But 


I'M = G(s)E(s) 

= G( S )[F(s)-H(s)Y(s)} 

Therefore 

y(s)[l + G(s)R(s)] = G(s)F(s) 
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so that 

rM CM 

F(s) 1 + G(s)H(s) ( 6 ' 69) ' 

Therefore, the feedback loop can be replaced by a single block with the transfer 
function shown in Eq. (6.69) (see Fig. 6.18d). 

In deriving these equations, we implicitly assume that when the output of one 
subsystem is connected to the input of another subsystem, the latter does not load 
the former. For example, the transfer function H t (s) in Fig. 6.18b is computed 
by assuming that the second subsystem H 2 (s) was not connected. This is the 
same as assuming that H 2 (s) does not load Hi(s). In other words, the input- 
output relationship of Ht(s) will remain unchanged regardless of whether H 2 (s) is 
connected or not. Many modern circuits use op amps with high input impedances, 
so this assumption is justified. When such an assumption is not valid, H 1 (s) must 
be computed under operating conditions (that is, when H 2 (s) is connected). 

The MATLAB example C6.3 allows us to determine the transfer function of 
the feedback system in Fig. 6.18d [Eq. (6.69)], when the transfer functions G(s) and 
H(s) are given. 

O Computer Example C6.3 

Find the transfer function of the feedback system of Fig 6 18d when G(s) = K 
H(s) = 1, and K = 7, 16, and 80. s(s+8) ’ 

For the sake of generalization, we shall split G(s) into two terms Gi(a) = K and 
2 7(s+8) • Such generalization allows us to use this program when G(s) is made up 
ot two subsystems in cascade. 

X (c62.m) 

Glnum=[0 0 K];Glden=[0 0 l]; 

G2num=[0 0 l];G2den=[l 8 0]; 

Hnum=[0 0 l];Hden=[0 0 1]; 

[Gnum,Gden]=series(Glnum,Glden,G2num,G2den); 

(ClGnum,ClGden]=feedback(Gnum,Gden,Hnum,Hden); 

printsys(ClGnum,ClGden) 

r n The » f f™, aC . k ‘ ranSfer function ’ when K = 7, 16, and 80, can be obtained by the 
following MATLAB commands: 

K=7;c 62 
num/den - 

7 


s'2 + 8 s + 7 

K=16,c62 
num/den = 

16 


s"2 + 8 s + 16 

K=80;c62 
num/den = 

80 


s"2 + 8 s + 80 O 
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6.6 System realization 

We now develop a systematic method for realization (or simulation) of an arbi- 
trary nth-order transfer function. Since realization is basically a synthesis problem, 
there is no unique way of realizing a system. A given transfer function can be re- 
alized in many different ways. We present here three different ways of realization: 
canonical, cascade and parallel realization. The second form of canonical realiza- 
tion is discussed in Appendix 6.1 at the end of this chapter. A transfer function 
H (s) can be realized by using integrators or differentiators along with summers and 
multipliers. For practical reasons we avoid the use of differentiators. A differen- 
tiator accentuates high-frequency signals, which, by their nature, have large rates 
of change (large derivative). Signals, in practice, are always corrupted by noise, 
which happens to be a broad-band signal; that is, the noise contains components of 
frequencies ranging from low to very high. In processing desired signals by a differ- 
entiator, the high-frequency components of noise are amplified disproportionately. 
Such amplified noise may swamp the desired signal. The integrator, in contrast, 
tends to suppress a high frequency signal by smoothing it out. In addition, practical 
differentiators built with op amp circuits tend to be unstable. For these reasons we 
avoid differentiators in practical realizations. 

Consider an LTIC system with a transfer function 

+ ftm-is” 1-1 + ■ ■ ■ + bjS + bp 
s n + a n _is n_1 + hais + ao 

For large s (s — ► oo) 


H(s) ~ b m s m ~ n 


Therefore, for m > n, the system acts as an (m - n)th-order differentiator [see 
Eq. (6.55)]. For this reason, we restrict m < n for practical systems. With this 
restriction, the most general case is m = n with the transfer function 


b n s n -t- 6 n _is" 1 + • • - + bis + bo 
s n + a n _is n_1 H 1- ajs + a 0 


(6.70) 



H^s) H 2 (>) 

(») (b) 

Fig. 6.19 Realization of a transfer function in two steps. 


6.6-1 Canonical or Direct-Form Realization 

Rather than realizing the general nth-order system described by Eq. (6.70), we 
begin with a specific case of the following third-order system and then extend the 
results to the nth-order case 

x b 3 s 3 + b 2 s 2 + bis + b 0 

H (s) = — = 5 

+ a 2 s + ais + ao 


(6.71) 
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Fig. 6.20 Realization of Hi(s) = A 

11 > s-> 


-f-a2« 2 +oi s+ao 


For convenience of realization, we shall express this transfer function as a cas- 
cade of two transfer functions H^s) and ff 2 (s), as depicted in Fig. 6.19. 




fes 3 + b 2 s 2 + bis + b 0 ) (6.72) 


" 777 ' 

The output of Hi(s) is denoted by A(s), as illustrated in Fig. 6.19b. Therefore 
, ^( s ) = (^3* 3 + b 2 s 2 -(- bis + bo) A(s) (6.73) 


5 F(s) ('6 741 

s 3 + a 2 s 2 + ois + a 0 w 

We shall first realize H i(s). Equation (6.74) enables us to write the differential 
equation relating x(t) to f(t) as 

or (D 3 + a 2 D 2 + ai D + a 0 )x(t) = f(t) (6.75a) 


x(t) + a 2 x(t) + ai x(t) + aox(t) = f(t ) 
a deduction which yields 

'i'(t) = — a 2 x(t ) - ai x(t) - a 0 x(t ) + f(t) 


(6.75a) 

(6.75b) 


(6.75c) 
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Our task is to realize a system whose input /(<) and output x(t) satisfy Eq. (6.75c). 
Let us assume that x is available. Successive integration of x yields x, i, and x (Fig. 
6.20a). We can now generate x from f(t), x, x, and x according to Eq. (6.75c), 
using the feedback connections, as shown in Fig. 6.20b.f The reader can verify that 
the system in Fig. 6.20b indeed satisfies Eq. (6.75c). Clearly, the transfer function 
of this system (Fig. 6.20b) is Hi(s) in Eq. (6.72). The signals x(t), x(i), and 
x(t) are available at points N\, N 2, and IV 3, respectively. If the initial conditions 
x(0), i(f), and i(0) are nonzero, they should be added at points N 1, N 2 , and IV3, 
respectively.): Figure 6.20c shows the system of Fig. 6.20b in frequency domain. 
Each integrator is represented by the transfer function 1/s [see Eq. (6.56)] . Signals 
/ (<) , x(t), x(t), x(t), and x(t) are represented by their Laplace transforms -F(s), 
A(s), sX(s), s 2 X(s ), and s 3 X(s), respectively. 



Fig. 6.21 Realization of H(s) = 


Figure 6.20c is a realization of the transfer function tfi(s) in Eq. (6.72). To 
realize the transfer function H(s), we need to augment H\(s) so that the final 
output Y (s) is generated from X(s) according to Eq. (6.73): 

Y (5) = (b 3 s 3 + b 2 s 2 4* bi s + bo)X ( s ) 

= b 3 s 3 X{s) + b 2 s 2 X (s) + bisX{s) + b 0 X(s) 

Signals X(s), sX($), s 2 X(s ), and s 3 X(s) are available at various points in Fig. 
6.20c so that Y (s) can be generated by using feedforward connections to the output 
summer, as depicted in Fig. 6.21. Therefore, the realization in Fig. 6.21 has the 
desired transfer function H(s) in Eq. (6.71). 

fit may seem odd that we first assumed the existence of x and generated x,x, x by its successive 
integration, and then in turn generated x from x, x, and x. This procedure poses a dilemma similar 
to “Which came first, the chicken or egg?” The problem here is satisfactorily resolved by writing 
the expression for x at the output of the summer in Fig. 6.20b and verifying that this expression 
is indeed the sarnie as Eq. (6.75c). 

jFor example, the initial condition x(0) can be incorporated into our realization by adding a 
constant signal of value x(0) at point N\. This follows from the fact that J Q x(r) dr = x(t) — x(0) y 
and x(t) = x(0) + J*x(r)dr. Similarly, the initial condition x(0) should be added at point JV2 , 
and so on. 



Fig. 6.22 Realization of the nth-order transfer function H(s) in Eq. (6.70). 


Generalization of this realization for the nth-order transfer function in Eq 
(6.70) is shown in Fig. 6.22. This is one of the two canonical realizations (also 
known as the controller canonical or direct-form realization). The second 
canonical realization (observer canonical realization) is discussed in Appendix 6.1 
at the end of this chapter. Observe that n integrators are required for a realization 
of an nth-order transfer function. The canonical (direct-form) realization procedure 
of an nth-order transfer function is systematic and straightforward, as illustrated in 
Fig. 6.22. After examining this figure, we can summarize the procedure as follows: 

1. Draw an input summer followed by n integrators in cascade. 

2. Draw the n feedback connections from the output of each of the n integrators 

to the input summer. The n feedback coefficients are 00,0^02, a n _!, 

respectively, and the feedback connections have negative signs (for subtraction) 
at the input summer. 

3. Draw the n + 1 feedforward connections to the output summer from the out- 
puts of all the n integrators and the input summer. The n + 1 feedforward 
coefficients are b 0 , b lt b 2 , ■ ■ ■ , b ni respectively, and the feedforward connections 
have positive signs (for addition) at the output summer. Observe that the con- 
nections ak and 6* start from the same point. Thus, the connections ao and 60 
start at the same point, and so do connections ai and b lt and so on. 

Ivote that a n is assumed to be unity and does not appear explicitly anywhere 
in the realization. If a n ± 1, then H(s) should be normalized by dividing both its 
numerator and its denominator by a n . 


M Example 6.18 

Find the canonical realization of the following transfer functions. 



(b) 


s + 5 
s + 7 


( c ) 


s 

s + 7 


(d) 


4s + 28 
s 2 + 6s + 5 


Ail four of these transfer functions are special cases of H(s) in Eq. (6.70). 

(a) In this case, the transfer function is of the first order (n = 1); therefore, we need 
only one integrator for its realization. The feedback and feedforward coefficients are 
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Fig. 6.23 Realization of 


ao = 2 and bo = 5 6i = 0 


The realization is depicted in Fig. 6.23. Because n — 1, there is a single feedback connection 
from the output of the integrator to the input summer with coefficient ao = 2. For n = 1, 
there are n -F 1 = 2 feedforward connections in general. However, in this case, bi = 0, 
and there is only one feedforward connection with coefficient bo = 5 from the output of 
the integrator to the output summer. Observe that because there is only one signal to 
be summed at the output summer, a summer is not needed. For this reason, the output 
summer is omitted in Fig. 6.23. 


(b) 


H(s) 


s + 5 
s + 7 


The realization appears in Fig. 6.24. Here H(s) is a first order transfer function with 
ao = 7 and 60 = 5, 61 = 1. There is a single feedback connection (with coefficient 7) from 
the integrator output to the input summer. There are two feedforward connections from 
the outputs of the integrator and the input summer to the output summer.f 



This first-order transfer function is similar to that in (b), except that 60 = 0. Therefore, 
the realization is similar to that in Fig. 6.24 with the feedforward connection from the 
output of the integrator missing, as depicted in Fig. 6.25a. Also, because there is only 


(When m = n (as in this case), H(s) can also be realized in another way by recognizing that 


H(s) = 1 - 


2 

s + 7 


We now realize H(s) as a parallel combination of two transfer functions, as indicated by the above 
equation. 
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7(r) 



(a) (b) 


Fig. 6.25 Realization of -~j 


one signal to be summed at the output summer, the output summer is omitted. The 
realization in Fig. 6.25a is redrawn in a more convenient form, as illustrated in Fig. 6.25b. 


(d) 


H(s) 


4s + 28 
s 2 + 6s + 5 


This is a second-order system with b 0 = 28, h = 4, b 2 = 0, a D = 5, ai = 6. 

Figure 6.26 shows a realization with two feedback connections and two feedforward 
connections. ■ 



A 


Exercise E6.9 
Realize the transfer function 


H(s) = 


2s 

s 2 + 6s + 25 


V 


6-6-2 Cascade and Parallel Realizations 

An nth-order transfer function H(s) can be expressed as a product or a sum of 
n first-order transfer functions. Accordingly, we can also realize H(s) as a cascade 
(series) or parallel form of these n first-order transfer functions. Consider for 
instance, the transfer function in part (d) of the last example: 
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(6.76a) 


(6.76b) 


Equation (6.76) gives us the option of realizing H(a) as a cascade of Hi(s) and 
H 2 (s), as shown in Fig. 6.27a, or a parallel of 7f3(s) and Hn(s), as depicted in 
Fig. 6.27b. Each of the first-order transfer functions in Figs. 6.27a or 6.27b can be 
realized by using a single integrator, as discussed in Example 6.18. 



Fig. 6.27 Realization of 


: (a) cascade form (b) parallel form. 


We have presented here three forms of realization (canonical, cascade, and 
parallel). The second canonical realization is developed in Appendix 6.1. However, 
this discussion by no means exhausts all the possibilities. Moreover, in the cascade 
form, there are different ways of grouping the factors in the numerator and the 
denominator of H(s). Accordingly, several cascade forms are possible. 

From a practical viewpoint, parallel and cascade forms are preferable because 
parallel and certain cascade forms are numerically less sensitive than canonical forms 
to small parameter variations in the system. Qualitatively, this difference can be 
explained by the fact that in a canonical realization all the coefficients interact with 
each other, and a change in any coefficient will be magnified through its repeated 
influence from feedback and feedforward connections. In a parallel realization, in 
contrast, the change in a coefficient will affect only a localized segment; the case 
with a cascade realization is similar. 

In the above examples of cascade and parallel realization, we have separated 
H(s) into first-order factors. For H(s) of higher orders, we could group H(s) into 
factors, not all of which are necessarily of the first order. For example, if H (s) is 
a third-order transfer function, we could realize this function as a cascade (or a 
parallel) combination of a first-order and a second-order factor. 
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Realization of Complex Conjugate Poles 

The complex poles in H ( s ) should be realized as a second-order (quadratic) 
factor because we cannot implement multiplication by complex numbers. Consider,* 
for example, 


H(s) 


10s + 50 

(s + 3)(s 2 + 4s + 13) 


10s + 50 

(s + 3)(«+2 - l’3)(s + 2 + j3) 


= — _ - 1+j2 _ izJl 

s + 3 s + 2-.73 s + 2 + j3 

We cannot realize first-order transfer functions individually with the poles -2 ± j3 
because they require multiplication by complex numbers in the feedback and the 
feedforward paths. Therefore, we need to combine the conjugate poles and realize 
them as a second-order transfer function.) In the present case, we can express H (s) 
as 


H(s) = 


s 2 + 4s + 13 


2 2s - 8 

s + 3 s 2 + 4s + 13 (6.77b) 

Now we can realize H (s) in cascade form using Eq. (6.77a) or in parallel form using 
Eq. (6.77b). 6 


Realization of Repeated Poles 

When repeated poles occur, the procedure for canonical and cascade realization 
is exactly the same as above. In parallel realization, however, the procedure requires 
a special precaution, as explained in Example 6.19 below. 


■ Example 6.19 

Determine the parallel realization of 

m \ _ 7f > 2 + 37s + 51 
(> (s + 2)(s + 3) 2 

_ _5 2 3 

s + 2 s + 3 (s + 3) 2 

- I* 1 * 8 third-order transfer function should require no more than three integrators, 

out it we try to realize each of the three partial fractions separately, we require four 
integrators because one of the terms is second-order. This difficulty can be avoided by 
observing that the terms l/(s + 3) and l/(s + 3) 2 can be realized with a cascade of two 
subsystems, each having a transfer function l/(s + 3), as shown in Fig. 6.28. Each of the 
three first-order transfer functions in Fig. 6.28 may now be realized as in Fig. 6.23. ■ 

A Exercise E6.10 

Find a canonical, a cascade, and a parallel realization of 


s + 3 

s 2 + 7s + 10 


\s + 2j \s + 5J 


fit is possible to realize complex, conjugate poles indirectly by using a cascade of two first-order 
transfer functions. A transfer function with poles -a ± jb can be realized by using a cascade of 
two identical first-order transfer functions, each having a pole at —a. (See Prob. 6.6-7.) 
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6.6-3 System Realization Using Operational Amplifiers 

In this section, we discuss practical implementation of the realizations described 
in the previous subsection. Earlier we saw that the basic elements required for the 
synthesis of an LTIC system (or a given transfer function) are (scalar) multipli- 
ers, integrators, and summers (or adders). All these elements can be realized by 
operational amplifier (op amp) circuits, as explained below. 



Fig. 6.29 A basic inverting configuration op amp circuit. 

Operational Amplifier Circuits 

Figure 6.29 shows an op amp circuit in the frequency domain (the transformed 
circuit). Because the input impedance of the op amp is infinite (very high), all of 
the current I(s) flows in the feedback path, as illustrated in Fig. 6.29. Moreover 
ki(s), the voltage at the input of the op amp, is zero (very small) because of the 
infinite (very large) gain of the op amp. Therefore, for all practical purposes, 
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Therefore, the op amp circuit in Fig. 6.29 has the transfer function 

rrt.l _ Z f( s ) 

(S) ~ ~~Z{s) (6 ' 78) 

By properly choosing Z(s) and Z f (s), we can obtain a variety of transfer functions, 
as the following development shows. 



The Scalar Multiplier 

If we use a resistor R f in the feedback and a resistor R at the input (Fig 
6.30a), then Zf(s) = Rf, Z(s) = R, and 

H ^ = ~1r (6.79a) 

The system acts as a scalar multiplier (or an amplifier) with a negative gain A 
positive gam can be obtained by using two such multipliers in cascade or by using 
a single nonmvertmg amplifier, as depicted in Fig. 6.16c. Figure 6.30a also shows 
the compact symbol used in circuit diagrams for a scalar multiplier. 

The Integrator 

n mi!! T! US t a , < f pacitor C in the feedback and a resistor R at the input (Fig. 
6.30b), then Zf(s) = 1/Cs, Z(s) = A, and 8 







424 


6 Continuous-Time System Analysis Using the Laplace Transform 




(a) (b) 

Fig. 6.31 Op amp summing and amplifying circuit. 


H(s) 


(6.79b) 


RC ) s 

The system acts as an ideal integrator with a gain -1/RC. Figure 6.30b also shows 
the compact symbol used in circuit diagrams for an integrator. 

The Summer 

Consider now the circuit in Fig. 6.31a with r inputs Fi(s), FMs), . . ., F r (s). As 
usual, the input voltage V x («) sz 0 because the gain of op amp — » oo. Moreover, the 
current going into the op amp is very small (is 0) because the input impedance — > oo. 

Therefore, the total current in the feedback resistor Rf is /i(s) + l 2 {s) -I b I r (s). 

Moreover, because V^s) = 0, 


I A*) = 


FAA 


3 = 1 , 2 ,... 


Also 


where 


Y{s) = - R S [h(s) + I 2 {s) + ■ ■ ■ + / r (s)] 

= - + T& F A<>) + • ■ ■ + $r*V( 3 )] 

= kiF\(s) + k 2 F 2 (s) + ■ • • + k r F r (s) 


(6.80) 


ki = 


-Rf 

Ri 


Clearly, the circuit in Fig. 6.31 serves a summer and an amplifier with any desired 
gain for each of the input signals. Figure 6.31b shows the compact symbol used in 
circuit diagrams for a summer with r inputs. 

M Example 6.20 

Using op amp circuits, realize the canonical form of the transfer function 

at ^ - 23 + 5 

H ^ s 2 + 4s + 10 


Fig. 6.32 Op amp realization of a second-order transfer function 

The basic canonical realization is shown in Fig. 6.32a. Signals at various points are 
also indicated in the realization. Op amp elements (multipliers, integrators, and summers) 
change the polarity of the output signals. To incorporate this fact, we modify the canonical 
realization in Fig. 6.32a to that depicted in Fig. 6.32b. In Fig. 6.32a, the successive outputs 
of the summer and the integrators are s 2 X(s ), sX(s), and X(s) respectively. Because 
of polarity reversals in op amp circuits, these outputs are -s 2 X(s), sX(s), and -A’(s) 
respectively in Fig. 6.32b. This polarity reversal requires corresponding modifications in 
the signs of feedback and feedforward gains. According to Fig. 6.32a 

s 2 X(s) = F(s) - 4sX (s) - 10A(s) 

- s 2 X(s ) = -F(s) + 4 sX(s) + 10X(s) 


Therefore 
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Fig. 6.33 Op amp circuits for exercise E6.ll. 


Because the summer gains are always negative (see Fig. 6.31b), we rewrite the above 
equation as 

— s 2 X(s) = -l[F(s)] - 4[-sX(s)] - 10(-X(s)] 

Figure 6.32b shows the implementation of this equation. The hardware realization appears 
in Fig. 6.32c. Both integrators have a unity gain which requires RC — 1. We have used 
ft=100 kfl and C = 10/rF. The gain of 10 in the outer feedback path is obtained in 
the summer by choosing the feedback resistor of the summer to be 100 kfl and an input 
resistor of 10 kf2. Similarly, the gain of 4 in the inner feedback path is obtained by using 
the corresponding input resistor of 25 kfl. The gains of 2 and 5, required in the feedforward 
connections, are obtained by using a feedback resistor of 100 kfl and input resistors of 50 
kfl and 20 kfl respectively. 

The op amp realization in Fig. 6.32 is not necessarily the one that uses the fewest 
op amps. It is possible to avoid the two inverting op amps (with gain -1) in Fig. 6.32 
by adding signal s X (s) to the input and output summers directly, using the noninverting 
amplifier configuration in Fig. 6.16. There are also circuits (such as Sallen-Key) which 
realize a first- or second-order transfer function using only one op amp. B 


A Exercise E6.ll 

Show that the transfer functions of the op amp circuits in Figs. 6.33a and 
and H 2 (s), respectively, where 


H2(s) 


R \s + aj 
a . 

Cf \s + a) 


° RfCf 

-L_ 6=^ 

RfCf RC 


V 


6.33b are Hi(s) 


6.7 Application to Feedback and Controls 

Generally, systems are designed to produce a desired output y(t) for a given 
input f(t). Using the given performance criteria, we can design a system shown in 
Fig. 6.34a. Ideally, such an open-loop system should yield the desired output. In 
practice, however, the system characteristics change with time, as a result of aging 
or replacement of some components, or because of changes in the environment in 
which the system is operating. Hence, for a given input, the output of the system 
will also change with time. This condition is clearly undesirable in precision systems. 


A possible solution to this problem is to apply an input that is not a predeter- 
mined function of time, but which will change to counteract the effects of changing 
system characteristics and the environment. In short, we must provide a correction" 
at the system input to account for the undesired changes mentioned above. But 
these changes are generally unpredictable, and it is difficult to program appropriate 
corrections to the input. However, the difference between the actual output and the 
desired output clearly indicates the suitable correction to be applied to the system 
input. Hence, we could make the input f(t) proportional to the desired output, and 
feed back the actual output y(t) to the input for comparison. The difference acts 
as the corrected input to the system. The input to the system is therefore continu- 
ously adjusted to obtain the desired response. Such systems (Fig. 6.34b) are called 
feedback or closed-loop systems for obvious reasons. We observe thousands of 
examples of feedback systems around us in everyday life. Most social, economical, 
educational, and political processes are, in fact, feedback processes. The human 
body itself is a fine example of a feedback system; almost all of our actions are 
the product of feedback mechanism. The human sensors such as eyes, ears, nose, 
tongue, and touch are continuously monitoring the state of our system. This infor- 
mation is fed back to the brain, which acts as a controller to apply corrected inputs 
through our motor mechanisms and thus accomplish the desired objective. 



Fig. 6.34 Open-loop and closed-loop (feedback) systems. 


Consider the process of driving an automobile. Our senses are continuously 
feeding the information to the brain. Eyes report seeing a child on the road. The 
brain will immediately apply input to the arms to steer the car away from the child. 
There is a red light ahead. Again the brain will apply the input to the legs to brake 
the car. Suddenly, ears report an ambulance siren; the brain will apply corrective 
input to steer the car off the street temporarily. A foul smell is reported by the 
nose. The brain will again take measures to speed away the car from the spot. In 
this example, the child, the red light, the ambulance siren, and the foul smell are 
unpredictable changes in the environment (fed back to the input by our senses). 
Despite these unpredictable changes in the environment, the process of reaching 
the destination is completed because of feedback. The foregoing is an example of 
multiple variable feedback. 

A feedback system can address the problems arising because of unwanted dis- 
turbances such as random-noise signals in electronic systems, a gust of wind affecting 
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a tracking antenna, a meteorite hitting a spacecraft, and the rolling motion of an- 
tiaircraft gun platforms mounted on ships or moving tanks. Feedback may also be 
used to reduce nonlinearities in a system, or control its rise time (or bandwidth). 
Feedback is used to achieve, with a given system, the desired objective within a 
given tolerance, despite partial ignorance of the system and the environment. A 
feedback system, thus, has an ability for supervision and self-correction in the face 
of changes in the system parameters, and external disturbances (change in the en- 
vironment). Consider the feedback amplifier in Fig. 6.35. Let the forward amplifier 
gain G — 10, 000. One hundredth of the output is fed back to the input (H = 0.01). 
The gain T of the feedback amplifier is obtained by [see Eq. ((6.69)] 


T = 


G 

1 + GH 


10, 000 
1 + 100 


99.01 


Suppose that because of aging or replacement of some transistors, the gain G of 
the forward amplifier changes from 10,000 to 20,000. The new gain of the feedback 
amplifier is given by 


T = 


G 

1 + GH 


20, 000 
1 + 200 


99.5 


Observe that 100% variation in the forward gain G causes only 0.5% variation in 
the feedback amplifier gain T. 



Fig. 6.35 Effects of positive and negative feedback. 


Now, consider what happens when we add (instead of subtract) the signal fed 
back to the input. Such addition means the sign on the feedback connection is + 
instead of - (which is same as changing the sign of H in Fig. 6.35). Consequently 



1 - GH 


If we let G = 10, 000 as before and H = 0.9 x 10 4 , then 


10, 000 

1 - 0.9(10 4 )(10- 4 ) 


100, 000 


Suppose that because of aging or replacement of some transistors, the gain of the 
forward amplifier changes to 11,000. The new gain of the feedback amplifier is 


11,000 

1 - 0.9(11, 000)(10- 4 ) 


1,100,000 


Observe that in this case, mere 10% increase in the forward gain G caused 1000% 
increase in the gain T (from 100,000 to 1,100,000). Clearly, the amplifier is very 
sensitive to parameter variations. This behavior is exactly opposite of what was 
observed earlier, when the signal fed back was subtracted from the input. 
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accounTof itself SyS j 6m Can P e f™ ^ this input, it is likely to give a good 

test contrL , UI f m ° St ° ther 6XpeCted situations. This is the reason why we 
test control systems for a step input. ^ 

For the step input 6,(1.) = u (t), Q^s) = \/ s and 

&o(s) = - T(s ) = 

■s s[l + AG(s)] 

Let the motor (with load) transfer function relating the load angle BJt) to the 
motor input voltage be G W = ^ [see Eq . (1 . 65)] . This yields g W the 


©o(«) = 


1 + K . 
^ s(s+8) 


s(s 2 + 8s + K) 


Let us investigate the system behavior for three different values of gain K . 


1. K = 7 


s(s 2 + 8s + 7) s(s + l)(s + 7) 


_s |_ 6 

i+l s+7 


0 o (t) = (1 - | e -‘ + J e -») u(t) 

This response, illustrated in Fig. 6.36c, appears rather sluggish To speed up the 
response let us increase the gain to, say, 80. P P h 

2. K = 80 


0 80 gQ 

s(s 2 + 8s + 80) s(s + 4 - j8)(s + 4 + j8) 
1 # e J 153 ° l/E e —J153° 

= - + + -i-1 

s s + 4-j8 s + 4 + 78 


9o(t) = [l + 4t cos (8t + 153°)J u(t) 


Thisj-esponse, depicted In Fig 6.36c, is certainly faster than in the earlier case 
b “* unfortunately the improvement is achieved at the cost of ringing 
s 2 % Thi § ov ^oot. In the present case the percent overshoot PO 

The ie^me 6 der e d reaC th eS T »** ^ at P6ak time = 0 393 seconds. 
90% of its ; f “ “ the tlme reqUlred for the res P°use to rise form 10% to 
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steadv sL steady-state value of the response is unity so that the 

ady-state error is zero. Theoretically it takes infinite time for the response to 
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reach the desired value of unity. In practice, however, we may consider the response 
to have settled to the final value if it closely approaches the final value. A widely 
accepted measure of closeness is within 2% of the final value. The time required 
for the response to reach and stay within 2% of the final value is called the settling 
time t s .f In Fig. 6.36c, we find t s ss 1 second. A good system has a small overshoot, 
a small value of t r and t s and a small steady-state error. 

A large overshoot, as in the present case, may be unacceptable in many appli- 
cations. Let us try to determine K (the gain) which yields fastest response without 
oscillations. Complex characteristic roots lead to oscillations; to avoid oscillations, 
the characteristic roots should be real. In the present case the characteristic poly- 
nomial is s 2 + 8s + K . For K > 16, the characteristic roots are complex; for K < 16, 
the roots are real. The fastest response without oscillations is obtained by choosing 
K = 16. We now consider this case. 

3. K = 16 

0 ( s ) = 16 = 16 

° s(s 2 + 8s + 16) s(s + 4) 2 

= 1 1_ _ 4 

s s + 4 (s + 4) 2 

and 

MO = [1 - (4t + l)e~ 4f ] u(t) 

This response also appears in Fig. 6.36c. The system with K > 16 is said to be 
underdamped (oscillatory response), whereas the system with K < 16 is said to 
be overdamped. For K = 16, the system is said to be critically damped. 

There is a trade-off between undesirable overshoot and rise time. Reducing 
overshoots leads to higher rise time (sluggish system). In practice, a small overshoot 
may be acceptable, which is still faster than the critical damping. Note that percent 
overshoot PO and peak time t p are meaningless for the overdamped or critically 
damped cases. In addition to adjusting gain K , we may need to augment the system 
with some type of compensator if the specifications on overshoot and the speed of 
response are too stringent. 

Ramp Input 

If the antiaircraft gun in Fig. 6.36a is tracking an enemy plane moving with a 
uniform velocity, the gun-position angle must increase linearly with t. Hence, the 
input in this case is a ramp; that is, MO = tu(t). Let us find the response of the 
system to this input when K = 80. In this case, 0j(s) = jj, and 

? 80 _ 0.1 1 0.1(s-2) 

s 2 (s 2 + 8s + 80) s s 2 + s 2 + 8s -1- 80 

Use of Table 6.1 yields 

»(0 = -0.1 + i+ie -8 * cos (8t + 36.87°) u(t) 

O 


(Typical percentage values used are 2% to 5% for t s . 
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iTnr in ^ ®‘ 36d ' Sh0WS that there » - steady-state error e„ = 
OT radian. In many cases such a small steady-state error may be tolerable If- 

however a zero steady-state error to a ramp input is reouired, this system in its 

present form is unsatisfactory. We must add somp fnrm rtf 

system. y 1 aaa some torm of compensator to the 

O Computer Example C6.4 

X = 7**16 tit; taT ° f the f6edbaCk SyStem in Fi §- 636b with G(s) = ^ if 

- 7, 16, and 80. Find the unit ramp response of this system for the case K = IP 7 

system. Tr^ we 'T ^ ° f this feedback 

command when the denominator^ C(T istltetp ofCo 

The command conv > multiDlies Difs} with n fo\ 0 i i 2( )• 

Di(s)D 2 (s) To find the stl j th D 2 (s) and gives the coefficients of the product 

m-file cett V " “ ramP reSP ° nSe f ° r " giV6n ValuC 0f we first create an 

l (c64a.m) 

Gnum=(0 0 K];Gden=conv([0 1 0],[0 1 8])- 
Hnum=[0 0 l];Hden=[0 0 1); 

[NumTF ) D en TFj=fee dback (G n um > G den, Hnu m, H den); 

step(NumTF,DenTF) 

To plot the Step response (as in Fig. 6.36c), we create another file c64b.m as: 

K_7;c64a; hold on, 

K=16;c64a; K=80;c64a 

K=80; c64a; 

NumTFr=NumTF; DenTFr=conv([0 1 0 ],DenTF)- 
printsys(NumTFr,DenTFr); ’ 

step(NumTFr,DenTFr) Q 

Design Specifications 

The above discussion has given the reader some idea of the various specifications 
a control system might require. In general we may be required to des gn l ontro 
system to meet some or all of the following specifications § 

Transient Response 

(a) Specified overshoot to step input. 

(b) Specified rise time t r and /or delay time t d . 

(c) Specified settling time t 3 . 

2. Steady-State Error 

Specified steady-state error to certain expected inputs such as step ramp 
or parabolic inputs. In control systems, the transient response is generally 
specified for the step input. The reason is that the step input represents a 

sudd en discontinuity . „ ence if a system ^ ^ P cce P ^; e e P “ a 

most of e the r n SteP t ^ " c kelY ‘° ^ aCCeptable -spouse ^ 

most of the practical inputs. Steady-state errors, however, must be specified 

for typical inputs of the system. For the given system one must determ ne what 
k nd 1 of input (step, ramp, etc) are likely to occur, and then specify acceptable 
steady-state requirements for these inputs. acceptable 
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3. Sensitivity 

The system, should satisfy a specified sensitivity specifications to some system 
parameter variations, or to certain disturbances. Sensitivity analysis will not 
be considered here. 

6.7-2 Analysis of a Second-Order System 

The transient response depends upon the location of poles and zeros of the 
transfer function. T(s). For a general case, however, there is no quick way of pre- 
dicting transient response parameters (PO, t r , t,) from the knowledge of poles and 
zeros of T(s). However, for a second-order system with no zeros, there is a direct re- 
lationship between the pole locations and the transient response. In such a case, the 
pole locations cam be immediately determined from the knowledge of the transient 
parameter specifications. As we shall see, the study of the second-order system can 
be used to study many higher-order systems. For this reason we shall now study 
the behavior of a second-order system in detail. 



Fig. 6.37 Pole location of a second-order system. 


Let us consider a second-order transfer function T(s), given by 


T{a) = 


s 2 + 2(u) n s + ui 2 


The poles of T(s) are — Ca> n ± ju> n ■Jl — £ 2 , as depicted in Fig. 6.37. These are 
complex when the damping ratio £ < 1 (underdamped case), and are real for 
C > 1 . C = 1 represents the critically damped and ( > 1 , the overdamped case. 
Smaller ( means smaller damping, leading to higher overshoot and faster response. 
For the unit step input F(s) = 1/s, and 


Y(s) = -2 

s(s 2 + 2 (w n s + u; 2 ) 

Use of Table 6.1 (pairs 1 and 10c) yields 


1 _ s + 2 C,u n 
s s 2 + 2 (u n s + 
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p- loo n ^ re ° f thlS response for the underdamped case (C < 1) is illustrated in 
' g - 6 ' 38 ' The response decays exponentially as Hence, the time constant 

of response is l/^u It takes four time constants for an exponential to decay to 
s lghtly less than 2% of its initial value. Hence, the settling time t s is given by 




(6.83) 


To determine the PO (percent overshoot), we find t p , the peak time where the peak 

overshoot occurs. At t = t p , dy/dt = 0. The straightforward solution of this 
equation yields 


t - w 

w n\/l — C 2 

Moreover, PO is given by 


PO = 1 x ioo% = 100 e -«v^ (6 g4) 

Figure 6.39 shows PO as a function of (. For a second-order system, the PO is 
directly related to the damping ratio 

We may now proceed to determine similar expressions for t r and t d . Unfor- 
tunately, these turn out to be transcendental equations. However, these equations 
can be solved on a computer. Results of these computation appear in Fig 6 39 

Although precise expressions for t r and t d cannot be found, useful approximations 
are 



(6.85) 
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Fig. 6.39 (a) Plots of PO, t , and t r as functions of damping ratio (. 

Clearly, for a second-order system the pole locations determine the transient 
behavior of the system. We observe that the closer the poles to the jw-axis, the 
smaller the value of £, and the larger the PO. Generally speaking, poles should 
not be too close to the jui- axis, a positioning which leaves too little safety margin 
for stability and makes the system sensitive to parameter variations. Hence it is 
generally desirable to have a larger value for ( (small PO). For a fast response it is 
desirable to have small values for t r , t 3 , t p and t a- 

This discussion shows that for a second-order system in Eq. 6.81, all the tran- 
sient parameters (PO, t r , t s , t p and td ) are related to the pole location of T(s). 
From the point of view of the system design, it will be convenient to draw the 
contours representing different values of transient parameters in the s-plane. For 
instance, each radial line drawn from the origin in the s-plane represents a constant 
C ' ine (see Fig. 6.37). Since the PO is directly related to ( (Fig. 6.39), each radial 
line also represents a line of constant PO, as depicted in Fig. 6.40. Similarly, each 
vertical line represents constant (see Fig. 6.37). Because t, = 4/Cw n , the lines 
representing constant settling time are vertical lines, as shown in Fig. 6.40. This fig- 
ure also shows the contours for constant t r . These contours allows us to determine 
by inspection, the important transient characteristics (PO, t r , t s ) of a second-order 
system from the knowledge of its pole locations. Moreover, if we are required to 
synthesize a second-order system to meet some given transient specifications, we 
can find the desired T(s) with the help of this figure. 

As an example consider the position control system in Fig. 6.36a. Let the 
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cent” ?r OUrS ? f SeCOnd -° rder s y stera Pole location for constant PO, constant t„ 
ana constant t r in s plane. s 

transient specifications for this system be given as 


PO < 16%, tr < 0.5 seconds t, < 2 seconds (6.86) 

We delineate appropriate contours in Fig. 6.40 to meet the above specifications The 
shaded region defined by these contours in Fig. 6.41 meets all the three requirements. 
Hence T(s) must be chosen so that both of its poles lie in the shaded region. The 
ransfer function T(s) for the closed-loop system in Fig. 6.36a is given by 


= KG M = AT 
1 + KG(s ) s 2 + 8s + K 


(6.87a) 


This shows that locations of the poles of T(s) can be adjusted by changing the gain 
^ a i ^ mu ^* choose the gain A so that the poles lie in the shaded region in Fig. 
• . The poles of T(s) are the roots of the characteristic equation 
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Fig. 6.41 Designing a second-order system to meet a given transient specifications. 

s 2 4- 8s + K = 0 (6.87b) 

Hence the poles are 

« 1)2 = -4 ± \/l6- K (6.87c) 

The poles sj and s 2 (the roots of the characteristic equation) move along a certain 
path in the s-plane as we vary K from 0 to oo. When K — 0, the poles are -8, 0. 
For K < 16, the poles are real and both poles move towards a value -4 as if 
varies from 0 to 16 (overdamping). For K = 16, both poles coincide at -4 (critical 
damping). For K > 16, the poles become complex with values -4 ± j\/K — 16 
(underdamping) Since the real part of the poles is -4 for all K > 16, the path of 
the poles is vertical as illustrated in Fig. 6.41. One pole moves up and the other 
(its conjugate) moves down along the vertical line passing through -4. We can 
label the values of K for several points along these paths, as depicted in Fig. 6.41. 
Each of these paths represents a locus of a pole of T(s) or a locus of a root of the 
characteristic equation of T(s) as A is varied from 0 to oo. For this reason this set 
of paths is called the root locus. The root locus gives us the information as to 
how the poles of the closed-loop transfer function T(s) move as the gain K is varied 
from 0 to oo. In our design problem, we must choose a value of K such that the 
poles of T(s) lie in the shaded region shown in Fig. 6.41. This figure shows that the 
system will meet the given specifications [Eq. (6.86)] for 25 < K < 64. For K = 64, 
for instance we have 

4 

PO = 16%, t r = 0.2 seconds, t a = - = 1 seconds (6.88) 
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Higher-order Systems 

Our discussion, so far, has been limited to second-order T(s) only If T(s) has 
additional poles which are far away to the left of j a, -axis, they have only a negligible 
effect on the transient behavior of the system. The reason is that the time constants 
of such poles are considerably smaller when compared to the time constant of the 
complex conjugate poles near the ju - axis. Consequently, the exponentials arising 
ecause of poles far away from the ju-axis die quickly compared to those arising 
because of poles located near the ju- axis. In addition, the coefficients of the former 
terms are much smaller than unity. Hence, they are also very small to begin with 
and decay rapidly. The poles near the ju - axis are called the dominant poles. A 
criterion commonly used is that any pole which is five times as far from the jw-axis 
as the dominant poles contributes negligibly to the step response, and the transient 
behavior of a higher-order system is often reduced to that of a second-order system 
In addition, a closely placed pole-zero pair (called dipole), contributes negligibly 
to the transient behavior. For this reason, many of the pole-zero configurations in 
practice reduce to two or three poles with one or two zeros. Workers in the field have 
prepared charts for transient behavior of these systems for several such pole-zero 
combinations, which may be used to design most of the higher-order systems. 



Fig. 6.42 A feedback system with a variable gain K. 


6.7-3 Root Locus 


The example in Sec. 6.7-2 gives a good idea of the utility of root locus in 
design of control systems. Surprisingly, root locus can be sketched quickly using 
certain basic rules provided by W.R. Evans in 1948.) With the ready availability 
of computers, root locus can be produced easily. Nevertheless, understanding these 
rules can be a great help in developing the intuition needed for design. We shall 
present here the rules, but omit the proofs of some of them. 

We begin with a feedback system depicted in Fig. 6.42, which is identical to 
■ r 6,1 fl’ e 6XCept f ° r the ex P llclt representation of a variable gain K . The system 
m Fig. 6.36a is a special case with H(s) = 1. For the system in Fig. 6.42, 


T{s) = ^£U) 

1 + KG{s)H(s) 

The characteristic equation of this system is| 


(6.89a) 


fThis procedure was developed as early as 1868 in Maxwell’s paper “On Governors”. 

r ^" C e . q “ a ‘ 10n is aIso valid when the gain X is in the feedback path [lumped with 
/f(s)I rather than m the forward path. The equation applies as long as the gain K is in the Mod 
at any point. Hence, the root locus rules discussed here apply to all such cafes. P 
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1 + KG(s)H(a) = 0 (6.89b) 

We shall consider the paths of the roots of 1 + KG(s)H(s) = 0 a s K varies from 
0 to oo. When the loop is opened, the transfer function is KG(s)H(s). For this 
reason, we refer to KG(s)H(s) as the open-loop transfer function. The rules 
for sketching the root locus tire as follows. 

1. Root loci begin (K = 0) at the open- loop poles and terminate on the open- 
loop zeros ( K = oo). This fact means that the number of loci is exactly n, 
the order of the open-loop transfer function. Let G(s)H(s) = N(s)/D(s), 
where N(s) and D(s) are polynomials of powers m and n, respectively. Hence, 

1 + KG(s)H{s) = 0 implies D(s) + KN(s) = 0. Therefore, D(s) = 0 when 
K — 0. In this case, the roots are poles of G(s)H(s)-, that is, the open-loop 
poles. Similarly, when K — ► oo, D(s) + KN(s) — 0 implies N(s) = 0. Hence, 
the roots are the open-loop zeros. For the system in Fig. 6.36a, the open-loop 
transfer function is K/s(s + 8). The open loop poles are 0 and -8 and the 
zeros (where K/s(s + 8) = 0 are both oo. We can verify from Fig. 6.41 that 
the root loci do begin at 0 and -8 and terminate at oo. 

2. A real axis segment is a part of the root locus if the sum of the real axis poles 
and zeros of G(s)H(s) that lie to the right of the segment is odd. Moreover, 
the root loci are symmetric about real axis. 

We can readily verify in Fig. 6.41 that the real axis segment to the right of -8 
has only one pole (and no zeros). Hence, this segment is a part of the root 
locus. 

3. The n — m root loci terminate at oo at angles kn/(n - m) for k = 1, 3, 5, — 
Note that, according to rule 1, m loci terminate on the open loop zeros, and 
the remaining n-m loci terminate at oo according to this rule. In Fig. 6.41, 
we verify that n - m = 2 loci terminate at oo at angles kir/2 for k = 1 and 3. 
Now we shall make an interesting observation. If a transfer function G(a) has 
m (finite) zeros and n poles, then lim s _»oo G(s) = s m /a n = l/s n ~ m . Hence, 
G{s) has n - m zeros at oo. This fact shows that although G(a) has only m 
finite zeros, there are additional n-m zeros at oo. According to rule 1, m loci 
terminate on m finite zeros, and according to this rule the remaining n — m 
loci terminate at oo, which are also zeros of G(s). This result means all loci 
begin on open loop poles and terminate on open loop zeros. 

4. The centroid of the asymptotes (point where the asymptotes converge) of the 
(n - m) loci that terminate at oo is 

_ (pi + P2 + • • • + Pn) — (zi + Z2 + ■ ■ • + Zm) 

° ( n — m ) 

where Pi , J >2 > • ■ • , Pn are the poles and z \ , zi, . . . , z m are the zeros, respectively, 
of the open-loop transfer function. 

Figure 6.41 verifies that the centroid of the loci is [(-8 + 0) - 0]/2 = -4. 

5. There are additional rules, which allow us to compute the points where the 
loci intersect and where they cross the ju axis to enter in the right-half plane. 
These rules allow us to draw a quick and rough sketch of the root loci. But 
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the ready availability of computers and programs makes it much easier to draw 
actual loci. The first four rules are still very helpful for a quick sketching oi 
the root loci. 

. Understanding these rules can be helpful in design of control systems as demon- 
strated later They are an aid in determining what modifications should be made 
(or what kind of compensator to add) to the open loop transfer function in order 
to meet given design specifications. 

I Example 6.21 

,„op bd ' “» *» ■ ■»“ •» 

L Rule 1: For this G>)R(s), n = 3. Hence, there are three root loci, which begin at 
the poles of G(s)J7(s); that is, at 0, -2 and -4. 

2. Rule 2: There are odd numbers of poles to the right of the real axis segment s < -4, 
and 2 < s < 0. Hence, these segments are the part of root locus. In other words’ 
the entire real axis in the left-half plane, except the segment between -2 and -4 is 
a part of the root locus. 

3. Rule 3: n - m = 3. Hence, (all) the three loci terminate at oo along asymptotes at 
angles fcx/3 for k - 1, 3 and 5. Thus, the asymptote angles are 60°, 120° and 180°. 

. Rule 4: The centroid (where all the three asymptotes converge) is (0 - 2-4)/3 = -2 

rT TZ t ^ e aS ^ mpt ° teS startin e at -2 at angles 60°, 120° and 180°, as shown in 
ig. 6.43. This information suffices to give an idea about the root locus. The actual 
root oci are also shown m Fig. 6.43. Two of the asymptotes cross over to the RHP 
behavior which shows that for some range of K, the system becomes unstable. ■’ 

O Computer Example C6.5 

Solve Example 6.21 using MATLAB. 

The MATLAB commands to find the root locus for this case are: 
num=[0 0 0 1]; 

den=conv(conv([l 0],[1 2]),[1 4]); 
rlocus(num, den), grid Q 


6.7-4 Steady-State Errors 

Steady-state specifications impose additional constraints on the closed-loop 
transfer function T{s). The steady-state error is the difference between the de- 
sired output [reference /(f)] and the actual output y(t). Thus e(t) = /(f) - y (t) 


E(s) = F(s) - Y(s) 

= r,_23f) 


= F(a)[l - T(s)] 


(6.90) 
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Pig. 6.43 A third-order feedback system and its root locus. 


The steady-state error e M is the value of e(f) as t -* oo. This value can be readily 
obtained from the final-value theorem [Eq. (6.68)]: 

e ss = lim sE(s) = lim sF(s)[l - T(s)] (6.91) 

3 — >o s — >o 

1. For the unit step input, the steady-state error e s is given by 

e. = lim [1 - T(«)] = 1 - T( 0) (6.92) 

s~* 0 

If T(0) = 1, the steady-state error to unit-step input is zero. 

2. For a unit ramp input, F(s) = 1/s 2 and e r , the steady-state error, is given by 

e r = lim 1 - T( - ) (6.93) 

s — >0 s 

If T(0) # 1, e r = oo. Hence for a finite steady-state error to ramp input, a necessary 
condition is T(0) = 1, implying zero steady-state error to step input. Assuming 
T(0) = 1 and applying L’Hopital’s rule to Eq. (6.93), we have 

e r = lim [— T(s)] = -f( 0) (6.94) 

s — 10 

3. Using a similar argument, we can show that for a unit parabolic input t = 
(t 2 /2)u(t), and F(s) = 1/s 3 and e p , the steady state error is 

f(0) 

2 


■p ~ 


(6.95) 
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Fig. 6.44 A unity feedback system with variable gain K. 


assuming T(0) = 1 and f (0) = 0. 

Many systems in practice have unity feedback, as depicted in Fig. 6.44. In 
such a case, the steady-state error analysis is greatly simplified. Let us define 
positional error constant K p , velocity error constant A„, and acceleration 
error constant K a as 
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If G(s) has no poles at the origin, then K p is finite and K v = K a = 0. Thus, 
for 

r , \ _ ( s + 2 ) 

(s + l)(s + 10) 

K p = K / 5 and K v — K a — 0. Hence, e s = 5/(5 + K) and e r = e p = oo. Such 
systems are designated as type 0 systems. These systems have finite e 3 , but infinite 
e r and e p . These systems may be acceptable for step inputs (position control), but 
not for ramp or parabolic inputs (tracking velocity or acceleration). 

If G (s) has two poles at the origin, the system is designated as type 2 system. 
In this case K p = K v = oo, and K a = finite. Hence, e s = e r = 0 and e p is finite. 

In general, if G(s) has q poles at the origin, it is a type q system. Clearly, 
for a unity feedback system, increasing the number of poles at the origin in G(s) 
improves the steady-state performance. However, this procedure increases n and 
reduces the magnitude of a, the centroid of the root locus asymptotes. This shifts 
the root locus towards the j'u-axis with consequent deterioration in the transient 
performance and the system stability. 

It should be remembered that the results in Eqs. (6.96) and (6.97) apply only 
to unity feedback systems (Fig. 6.44). Steady-state error specifications in this case 
are translated in terms of constraints on the open-loop transfer function KG(s). 
In contrast, the results in Eqs. (6.92) through (6.95) apply to unity as well as 
nonunity feedback systems, and are more general. Steady-state-error specifications 
in this case are translated in terms of constraints on the closed-loop transfer function 
T(s). 

The unity feedback system in Fig. 6.36a is type 1 system. We have designed 
this system earlier to meet the following transient specifications: 

PO = 16%, t r < 0.5, t,< 2 (6.99) 

Let us further specify that the system meet the following steady-state specifications: 

e s = 0, e T < 0.15 

For this case, we already found e s = 0, e r = 8/K and e p = oo [see Eq. (6.98)]. But 
we require e r < 0.15. Therefore 

— < 0.15 => K > 53.34 (6.100) 

K ~ 

Turning to Fig. 6.41, we note that the poles of T(s) lie in the acceptable region 
to meet transient specifications (25 < K < 64). Equation (6.100) shows that we 
must use K > 53.34 to meet steady-state performance. Therefore to meet both 
the transient and the steady-state specifications we must set the gain in the range 
53.34 < K < 64. The smallest steady-state error for a ramp input is obtained for 
K = 64. For this case, 



Thus if the system is to meet the transient performance in Eq. (6.99), the minimum 
e r = 0.125. We can do no better. In case we are required to have e r < 0.125 
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Fig. 6.45 A lead compensator. 

while maintaining the same transient performance, we will have to use some kind 
or compensation. 

6.7-5 Compensation 

The synthesis problem for the position control system in Fig. 6.36a is a very 
simp e example where the transient and steady-state specifications could be met by 
simple adjustment of gam K. In many cases, it may be impossible to meet both 
sets of specification (transient and steady state ) by simple adjustment of the gain 
K. We may be able to satisfy one set of specifications or the other but not both 
Consider again the system in Fig. 6.36a, with the following specifications: 

PO = 16% t r <0.5 t s < 2 e s = 0 e r < 0.05 
To meet the steady-state specification we must have 

8 

— < 0.05 => K > 160 

f r U ‘ F t ig ,, 6 f “ dicates that for * > 64, the poles of T(s) move out of the region 
acceptable for transient performance. Clearly, we can meet either the transient or 
the steady-state specification but not both. In such case we must add some kind 
of compensation, which will modify the root locus to meet all the specifications. A 
ittle familiarity with root-locus techniques gives the insight and judgment needed to 
choose a proper compensator transfer function. Figure 6.41 indicates that shifting 
the root locus to the left will accomplish the desired performance. We can place a 
compensator of transfer function G c (s) in series with G(s) (Fig. 6.45a) and select 
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Fig. 6.46 Root locus of the system in Fig. 6.36a after lead compensation. 

the poles and zeros of G c (s) in such a way as to shift the centroid of the root locus 
to the left. If G c (s) has a single pole and a single zero, then choosing the pole 
farther to the left of the zero would shift the centroid to the left according to the 
fourth rule of the root locus. Thus, we use 


Such a compensator is called the lead compensator, which is readily realized 
using a simple RC circuit shown in Fig. 6.45b. We have a wide choice for values of 
a and 0. To simplify design, let us choose a = 8 and 0 = 30. This choice yields 


G c (s)[KG(s)] 


/ s + 8 \ K _ K 
ys + 30 J s(s 4- 8) s(s + 30) 


To simplify our discussion we deliberately chose a = 8 to cancel the pole of G(s). 
In practice, we do not necessarily have to cancel the pole of G(s). In the present 
situation, c = (-30 + 0)/2 = 15, and the new root locus appears in Fig. 6.46. 
Observe that the situation has improved considerably by shifting the centroid from 


—4 to -15. If we select K = 600, we have 


T(s) = 


600 



600 

s 2 + 30s + 600 


In this case uj n = \/600 = 24.5. Also = 15. Hence, C = 15/24.5 = 0.61 and 
t s = 4/(w n — 4/15 = 0.266. From Eq. (6.84), we find PO=8.9%. Moreover, from 
Fig. 6.39 [or Eq. (6.85)], for C = 0.61, we find uj n t r = 1.83 so that i r = 1.83/24.5 = 
0.0747. We also have 
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We shall now discuss a compensation which is primarily used to improve tin 
steady-state performance. For unity feedback systems, the steady-state performanc, 
of a system is improved by placing an integrator in the forward path of G(s) 
This procedure increases the system type, thus increasing K„, K v , K„ etc Tht 
compensator in this case is G c (s) - 1/s. * 

In this scheme the compensator is an ideal integrator. Hence, this scheme is 
known as integral control. Design of an ideal integrator necessitates elaborate and 
expensive equipment. Hence, such a compensator is used where cost considerations 
are not very important. For example, integrating gyroscopes are used for this 
purpose in aircraft. In most cases a lag compensator (described below) which 
closely approximates the a behavior of an integrator is used. A lag compensator 
transfer function is given by 



!ag compensator can be readily realized using a simple RC circuit depicted in 
f ig 6.47. For a unity feedback system, addition of a compensator G c (s) causes 
a he error constants K p , K v , K a , etc., to be multiplied by G c (0). Thus the 
ag compensator increases K p , K v , K a „ etc. by a factor (a/0), thereby reducing 
steady-state errors. 6 




Fig. 6.47 A lag compensator. 

A lag compensator improves the steady-state performance, but in general de- 
grades the transient performance. Since a > 0, the magnitude of <r, the root locus 
centroid, is reduced. This reduction causes the root locus to shift toward the ju- 
ax!s, with the consequent deterioration of the transient performance. This side 
effect of a lag compensator can be made negligible by choosing a and 0 such that 
a 0 is very small, but the ratio a/0 is high. Such a pair of pole and zero act like a 
dipole and has only a negligible effect on the transient behavior of the system. The 
root locus also changes very little. We can realize such a dipole by placing both 
e pole and the zero of G c (s) close to the origin ( a and 0 — 0). For instance, if 
we select a - 0.1 and 0 = 0.01, the centroid will be shifted by only a negligible 
amount (a - 0)/( n - m) = 0.09/ (n - m). However, since a/0 = lo! all the error 
constants are increased by a factor 10. Thus, we can have our cake and eat it too! 
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We can improve the transient and the steady-state performance simultaneously by 
using a combination of lead and lag networks. 

6.7-6 Stability Considerations 


In practice, we rarely use positive feedback because, as explained earlier, such 
systems are prone to instability and are very sensitive to changes in the system 
parameters or environment. Would negative feedback make a system stable and less 
sensitive to unwanted changes? Not necessarily! The reason is that if a feedback 
were truly negative, the system would be stable. But a system that has negative 
feedback at one frequency may have a positive feedback at some other frequency 
because of phase shift in the transmission path. In other words, a feedback system, 
generally, cannot be described in black and white terms such as having positive or 
negative feedback. Let us clarify this statement by an example. 

Consider the case G(s)H ( s ) = l/s(s + 2)(s + 4). The root locus of this system 
appears in Fig. 6.43. This system shows negative feedback at lower frequencies. 
But because of phase shift at higher frequencies, the feedback becomes positive. 
Consider the loop gain G(s)H (s) at a frequency ui = 2.83 (at s = j2.83). 


G(jw)H (ju) 


1 

4- 2 )(ja> + 4) 


At uj = 2.83 


G(j2.83)tf(j2.83) 


1 

j2.83(j 2.83 + 2)(j2.83 + 4) 

_L--j' 180 ° = _ _L 

48 48 



As long as K remains below 48, the system is stable, but for K = 48, the system gain 
goes to oo, and the system becomes unstable. The feedback, which was negative 
below w = 2.83 (because the phase shift has not reached -180°), becomes positive. 
If there is enough gain ( K = 48) at this frequency, the signal fed back is equal to the 
input signal, and the signal perpetuates itself for ever. In other words, the signal 
starts generating (oscillating) at this frequency, which is precisely the instability. 
Note that the system remains unstable for all values of K > 48. This is clear from 
the root locus in Fig. 6.43, which shows that the two branches cross over to the 
RHP for K > 48. The crossing point is s = /2.83. 

This discussion shows that the same system, which has negative feedback at 
lower frequency may have positive feedback at higher frequency. For this reason, 
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feedback system are quite prone to instability, and the designer has to pay a great 
deal of attention to this aspect. Root locus does indicate the region of stability. 


6.8 The Bilateral Laplace Transform 


Situations involving noncausal signals and/or systems cannot be handled by 
the (unilateral) Laplace transform discussed so far. These cases can be analyzed by 
the bilateral (or two-sided) Laplace transform defined by 



and /(f) can be obtained from F(s) by the inverse transformation 


(6.101a) 


J /•c+joo 

> = r-/ F(s)e st ds 
Jc-jcc 


(6.101b) 


Observe that the unilateral Laplace transform discussed so far is a special case of 
the bilateral Laplace transform, where the signals are restricted to the causal type. 
Basically, the two transforms are the same. For this reason we use the same notation 
for the bilateral Laplace transform. 

Earlier we showed that the Laplace transforms of e~ at u(t ) and of -e at u{-t) 
are identical. The only difference involves their regions of convergence. The region 
of convergence for the former is Res > -a; that for the latter is Res < -a, as 
illustrated in Fig. 6.2. Clearly, the inverse Laplace transform of F(s ) is not unique 
unless the region of convergence is specified. If we restrict all our signals to the causal 
however, this ambiguity does not arise. The inverse transform of l/(s + a) 
is e “ u(t). Thus, in the unilateral Laplace transform, we can ignore the region of 
convergence in determining the inverse transform of F(s). 

We now show that any bilateral transform can be expressed in terms of two 
unilateral transforms. It is, therefore, possible to evaluate bilateral transforms from 
a table of unilateral transforms. 

Consider the function /(f) appearing in Fig. 6.48a. We separate /(f) into two 
components, /i (t) and / 2 (f), representing the positive time (causal) component 
and the negative time (anticausal) component of /(f) respectively (Figs 6 48b 
and 6.48c): 

/i(0 = /(<)“(*) (6.102a) 


/ 2 (f) = f{t)u{-t ) (6.102b) 

The bilateral Laplace transform of /(f) is given by 



= F 2 (s) + Fi(s) 


(6.103) 
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(d) 

Fig. 6.48 Expressing a signal as a sum of causal and anticausal components. 

where Fi(,) is the Laplace transform of the causal component /i(t) and F 2 (s) is 
the Laplace transform of the anticausal component / 2 (f)- But F 2 (s) is given by 

,° 

U 2 (s)= / f 2 (t)e~ st dt 
f 2 (-t)e st dt 

Therefore 

A OO 

F 2 (s)= h{-t)e~ st dt (6.104) 

Jo 

It is clear that .F 2 (— s) is the Laplace transform of / 2 (-t), which is causal (Fig. 
6.48d), so F 2 ( — s ) can be found from the unilateral transform table. Changing the 
sign of s in F 2 (— s) yields F 2 (s). 
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-I'ssjssr- rsr " *• <e ira » - »• 

tively. ) SPht f ^ mt ° ltS CaUSal and anticausal components, f x (t) and / 2 (t), respec- 

2) The signals /i(t) and / 2 (-t) are both causal. Take the (unilateral) Laplace 

/replaced bv^ s tv ^ ^ ^ (unilateral ) La P lace transform of / 2 (-t), with 
replaced by This procedure gives the (bilateral) Laplace transform of /(<). 

LapWeTra^sform 1 / f t' 0 ^ Fl(s) ^ are both ^lateral 

Laplace transforms. Let cr cl and * c2 be the abscissas of convergence of FU,) and 

F 2 (-s) respectively. This statement implies that F l( ,) exists for all , with Res > 

_ cl ' i~ s) eX1S ‘* * ™ th Res > <Tc 2, and F2(s) exists for all , with Res < 

c 2 - ecause F(s) _ Fi(s) + F 2 (s), F(s) exists for all s such that 


<r c i < Res < 


(6.105) 



! i Re S' on of convergence for causal component of /( t) . 

Region of convergence for anticausal component of /( t ) . 

^1 Region (strip) of convergence for the entire /((). 

Fig. 6.49. 

in F Th fi e Jo S D nS of convergence (or existence) of F y {s), F a (s), and F(s) are shown 

" ! < Re , < 6CaUS 1 F( 1 “ fOT aU ValU6S ° f 5 Iying in the stri P of convergence 
i Cl < Re, < <7 c2 ), poles of F(s) must lie outside this strip. The poles of F(s) 

arising from the causal component fl (t) lie to the left of the strip region) of 

(sTFT E ge 6 n 4 C 9) " Thl fTT from j ts antica ^al component f 2 (t) lie to its right 
trlnsfofm ’ ' S ° importance in finding the inverse bilateral 

As an example, consider 


(6.106) 


We already know the Laplace transform of the causal component 


Res > a 


For the anticausal component, / 2 (i) = e bt u(-t), we have 


(6.107) 
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so that 


Therefore 


fi(-t) = e 


F 2 (s) = 


• 

1 

— s + b 


1 

s + b 

-1 
s — b 


Res > —6 


Res < b 


e bt u(—t) Res < b 

s — b 

and the Laplaxe transform of f(t) in Eq. (6.106) is 


(6.108) 


F(s) = — — 1 — Res > a and Res < b 

s — b s — a 

= - ^ a < Res <6 (6.109) 

(s - 6)(s — a) 

Figure 6.50 shows f(t) and the region of convergence of F(s) for various values 
of a and b. Equation (6.109) indicates that the region of convergence of F(s) does 
not exist if a > b, which is precisely the case in Fig. 6.50g. Observe that the 
poles of F(s) are outside (on the edges) of the region of convergence. The poles of 
F(s) because of the anticausal component of f(t) lie to the right of the region of 
convergence, and those due to the causal component of f(t) lie to its left. 


I Example 6.22 

Find the inverse Laplace transform of 

F{S) = (s + 2)(s — 1) 

if the region of convergence is (a) — 2 < Res < 1 (b) Res > 1 (c) Res < —2. 


(*) p (‘>-rT2-^ 

Now, F(s) has poles at -2 and 1. The strip of convergence is -2 < Res < 1. The pole at 
-2, being to the left of the strip of convergence, corresponds to the causal signal. The pole 
at 1, being to the right of the strip of convergence, corresponds to the anticausal signal. 
Equations (6.107) and (6.108) yield 

f(t) = e~ 2t u(t) + e'u(-f) 

(b) Both poles lie to the left of the region of convergence, so both poles correspond 
to causal signals. Therefore 

f(t) = (e~ 2t - e')u (t) 

(c) Both poles lie to the right of the region of convergence, so both poles correspond 
to anticausal signals, and 

fif) = (— e -2t + e*)u(— t) 
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Figure 6.51 shows the three inverse transforms corresponding to the same F(s) but 
with different regions of convergence. B 

6.8-1 Linear System Analysis Using the Bilateral Transform 

Since the bilateral Laplace transform can handle noncausal signals, we can 
analyze noncausal LTIC systems using the bilateral Laplace transform. We have 
shown that the (zero-state) output y(t) is given by 

y(t) = /2- 1 [i^( S )iT(a)] (6.110) 

This expression is valid only if F(s)H(a) exists. The region of convergence of 
F(s)H (s) is the region where both F(s) and H ( s ) exist. In other words, the region 
of convergence of F(s)H{s ) is the region common to the regions of convergence of 
both F(s) and H {a). These ideas are clarified in the following examples. 

fl Example 6.23 . 

Find the current y(t ) for the RC circuit in Fig. 6.52a if the voltage f(t) is 


/(f) = e*u(t) + e 2t u(— t) 

The transfer function H(s) of the circuit is given by 


H(s) 


s 

7+i 


Because h(t) is a causal function, the region of convergence of H{s) is Res > -1. Next, 
the bilateral Laplace transform of /(f) is given by 



1 

s - 2 


-1 

( s — l)( s — 2) 


1 < Res < 2 
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Fig. 6.52 Response of a circuit to a noncausal input (Example 6.23). 
The response y(t) is the inverse transform of F(s)H(a) 


y(t) = C 


(s + l)(s-l)(s-2) 


= c - i ri_i_ 1_1 2 1 ■ 

16 s + 1 2 s — 1 3s -2. 


The region of convergence of F(s)H(s) is that region of convergence common to both 
F(s) and H{s). This is 1 < Res < 2. The poles s = ±1 lie to the left of the region of 
convergence and, therefore, correspond to causal signals; the pole s = 2 lies to the right of 
the region of convergence and thus represents an anticausal signal. Hence 

y{t) = |e _t u(f) + |e‘u(f) + | e 21 u(-f) 

Figure 6.52c shows y(t). Note that in this example, if 

/(f) = e~ 4t u(t) + e~ 2 ‘u(—t) 

then the region of convergence of F(s) is -4 < Res < -2. Here no region of convergence 
exists for F(s)H($ ), and the response y(t) goes to infinity. B 

B Example 6.24 

Find the response y(t) of a noncausal system with the transfer function 
H{s) = — - 1 - Res < 1 


to the input /(f) = e~ 2t u(t). 
We have 


Re s > —2 


and 
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y(.) = F(,)g(.)= ( a _ 

The region of convergence of F(s)H(s) is, therefore, the region — 2 < Res < 1. By partial 
fraction expansion 


-1/3 1/3 

V(s) = 731 + 772 


- 2 < Re s < 1 


y(t) = \ [e*u(— t) + e _2t u(t)] 

Note that the pole of H(s) lies in the RHP at 1. Yet the system is not unstable. The 
pole(s) in the RHP may indicate instability or noncausality, depending on its location 
with respect to the region of convergence of H(s). For example, if H(s) = -l/(s - 1) 
with Res > 1, the system is causal and unstable, with h(t) = -e‘u(t). In contrast, if 
H(s) = -l/(s- 1) with Res < 1, the system is noncausal and stable, with h(t) = e u(-t). 


Example 6.25 

Find the response y(t) of a system with the transfer function 
H(s) = — i-r Re s > -5 


and the input 


f(t) = e~ ( u(t) + e -2t ti(— t) 


The input f(t) is of the type depicted in Fig. 6.50g, and the region of convergence 
for F(s) does not exist. In this case, we must determine separately the system response 
to each of the two input components, fi(t) = e *u(t) and /2(f) = e u(~t). 


a(«) = 


Res > -1 


aW = 7^ Res <-2 

If y\ (t) and y 2 (t) axe the system responses to /i(f) and / 2 (t), respectively, then 


( S + l)(» + 5) 
1/4 _ 1/4 
s + 1 s + 5 


Res > —1 


y.W -K*"* -«■“)“(*) 


y»w = 


(s + 2)(s + 5) 

-1/3 1/3 

s ■+■ 2 s ■+• 5 


• 5 < Res < -2 


6.9 Appendix 6.1: Second Canonical realization 


457 


so that 


Therefore 


f/2 (t) = I [e 2t u(-t) + e 5t u(t)] 
y(t ) = 2/i (t) + y 2 (t) 

= |e u(—t) + 4 + 5i ^u(t) I 



T(s) = b 3 F(s) + j[-a 2 K(s) + 6 2 F(s)J + i[- ai T(s) + 6iF(s)] 

+ ~sl~ a o Y ( s ) + i'oF(s)] (6.112) 

Therefore, Y(s) can be generated by adding four signals appearing on the right-hand 
side of Eq. (6.112). We shall build T(s) step by step, adding one component at a 
time. Figure 6.53a shows only the first component; that is, b 3 F(s). Figure 6.53b 
shows Y(s) formed by the first two components, b 3 F(s) and j[-a 2 Y(s) 4- 6 2 F(s)]. 
Observe that the term a 2 Y(s ) is obtained from Y(s) itself. Ve add -a 2 Y(s) to 
6 2 F(s) and pass it through an integrator to obtain j[-a 2 Y(s) + 6 2 F(s)]. Figure 
6.53c shows Y(s) built up from the first three components. Finally, Fig. 6.53d shows 
T(s) built up from all the components. This is the final form, which represents an 
alternative realization of H(s) in Eq. (6.111). 

This realization can be readily generalized for an nth-order transfer function 
in Eq. (6.70) using n integrators. 



Fig. 6.53 Second (observer) canonical realization of an nth-order transfer function. 


6.10 Summary 

The Fourier transform cannot be used directly in analysis of unstable, or even 
marginally stable systems. Moreover, the inputs must also be restricted to Fourier 
transformable signals, which leaves out exponentially growing signals. Both these 
limitations are the result of the fact that the spectral components used in the Fourier 
transform to synthesize a signal /(t) are ordinary sinusoids or exponentials of the 
form e JU,t , whose frequencies are restricted to the ju axis in the complex plane. 



6.10 Summary ^ g 

These spectral components are incapable of synthesizing exponentially growing sig- 
nals. We extend the Fourier transform by generalizing the frequency variable from 
s - ju to s = a + jui. The resulting transform is the Laplace transform which 
can analyze all types of LTIC systems. The Laplace transform can also handle 
exponentially growing signals. 

The system response to an everlasting exponential e st is also an everlasting 
exponential H(s)e st , where H (s) is the system transfer function. We can view the 
Laplace transform as a tool by which a signal is expressed as a sum of everlasting 
exponentials e s . The relative amount of a component e 3t is F(s). Therefore F(s), 
the Laplace transform of /(t), represents the spectrum of exponential components 
-'(*)■ Moreover, H (*) is the system response (or gain) to a spectral component 
e , and the output signal spectrum is the input spectrum F(s) times the spectral 
response (gain ) H (s) [Y (s) = F(s)H (s)]. 

The Laplace transform changes integro-differential equations of LTIC systems 
into algebraic equations. Therefore, solving these integro-differential equations re- 
duces to solving algebraic equations. The Laplace transform method cannot gener- 
ally be used for time-varying parameter systems or for nonlinear systems. 

The transfer function of a system may also be defined as a ratio of the Laplace 
transform of the output to the Laplace transform of the input when all initial 
conditions are zero (system in zero state). If F(s) is the Laplace transform of the 
input f(t) and Y (s) is the Laplace transform of the corresponding output y(t) (when 
all initial conditions are zero), then Y(s) = F(s)H(s), where H(s) is the system 
transfer function. The system transfer function H (s) is the Laplace transform of the 
system impulse response h(t). Like the impulse response h(t), the transfer function 
H (s) is also an external description of the system. 

Electrical circuit analysis can also be carried out by using a transformed circuit 
method, in which all signals (voltages and currents) are represented by their Laplace 
transforms, all elements by their impedances (or admittances), and initial conditions 
by their equivalent sources (initial condition generators). In this method, a network 
can be analyzed as if it were a resistive circuit. 

Large systems can be considered as suitably interconnected subsystems repre- 
sented by blocks. Each subsystem, being a smaller system, can be readily analyzed 
and represented by its mput-output relationship, such as its transfer function. Anal- 
ysis of large systems can be carried out with the knowledge of input-output rela- 
tionships of its subsystems and the nature of interconnection of various subsystems. 

LTIC systems can be realized by scalar multipliers, summers, and integrators. 

A given transfer function can be synthesized in many different ways. Canonical, 
cascade, and parallel forms of realization are discussed. In practice, all the building 
blocks (scalar multipliers, summers, and integrators) can be obtained from opera- 
tional amplifiers. 

Feedback systems are closed-loop systems mainly used to counteract the effects 
of unpredictable variations in the system parameters, the load, and the environment, 
buch systems are designed for a specified speed and the steady-state error. For 
speed, the useful transient parameters are rise time, peak time, and settling time. 
Percent overshoot indicates how smoothly the system output rises to its final value. 
We can relate the steady-state error to system parameters. In many cases, adjusting 
the amplifier gain K can result in the desired performance. If the requirements 
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cannot be satisfied by mere adjustment of gain, then some form of compensation 
must be used. The loci of the characteristic roots of the system are called the root 
locus, which proves extremely convenient in designing a feedback system. 

Most of the input signals and practical systems are causal. Consequently, we 
are required most of the time to deal with causal signals. When all signals are 
restricted to the causal type, the Laplace transform analysis is greatly simplified; 
the region of convergence of a signal becomes irrelevant to the analysis process. 
This special case of the Laplace transform (which is restricted to causal signals) 
is called the unilateral Laplace transform. Much of the chapter deals with this 
variety of Laplace transform. Section 6.8 discusses the general Laplace transform 
(the bilateral Laplace transform), which can handle causal and noncausal signals 
and systems. In the bilateral transform, the inverse transform of F(s) is not unique 
but depends on the region of convergence of F(s). Thus the region of convergence 
plays a very crucial role in the bilateral Laplace transform. 

References 

1. Doetsch, G., Introduction to the Theory and Applications of the Laplace Trans- 
formation with a Table of Laplace Transformations , Springer Verlag, New York, 
1974. 

2. LePage, W.R., Complex Variables and the Laplace Transforms for Engineers, 
McGraw-Hill, New York, 1961. 

3. Durant, Will, and Ariel, The Age of Napoleon, The Story of Civilization Series , 
Part XI, Simon and Schuster, New York, 1975. 

4. Bell, E.T., Men of Mathematics, Simon and Schuster, New York, 1937. 

5. Nahin, P.J., “Oliver Heaviside: Genius and Curmudgeon,” IEEE Spectrum, 
vol. 20, pp. 63-69, July 1983. 

6. Berkey, D., Calculus, 2nd ed., Saunder’s College Publishing, Philadelphia, Pa. 
1988. 

7. Encyclopaedia Britannica, Micropaedia IV, 15th ed., Chicago, IL. 1982. 

8. Churchill, R.V., Operational Mathematics, 2nd ed, McGraw-Hill, New York, 
1958. 

9. Yang, J.S. and Levine, W.S. Chapter 10 in The Control Handbook, CRC Press, 
1996. 

Problems 

1.1-1 By direct integration [Eq. (6.8b)] find the Laplace transforms and the region of con- 
vergence of the following functions: 

(a) u(t) - u(t - 1) (e) COS W\t COS u)2 1 u(t) 

(b) te~ t u(t) (f) cosh (at)u(t) 

(c) tcos uot u(t) (g) sinh (at)u(t) 

(d) (e 2t — 2 e~ t )u(t) (h) e~ 2t cos (5t + 0) u(t) 


Problems 


I | ■ — | i 

W (b) 1 (0 

Fig. P6.1-2 

' r’ “ ,h * iwi *“ “• *-■. .1.°™ » n g p S i_2 

d ““ L *F l “ ™>f™ .f the following foooi.io,,; 

2., 2s + 5 

( ) PT57+6 (f)_i±i_ 

, s(s + 1)2 

(b) 3s±_5 

s 2 + 4s + 13 (g)- l 

!. + ■)• <, + 1M * + !) ‘ 

s 2 -s- 6 (h)- i±i 

s(s + 2) 2 (s 2 + 4s + 5) 


(e)- 

(s + l)(s 2 + 2s + 2) 


(® + l) 2 (s 2 + 2s + 5) 


(a) « ( t) (e) - T ) 

(b) e -( ‘- T) u(t — r) (f) sinMt-r)] u( t- T ) 

(c) e (t T) u(t) (g) sin [w 0 (t — t)] u(t) 

(d) e~‘u(t - r) (h) sin u 0 t u(t - r) 

6 J ' 2 "f’S ■”>«* .h, Laplace 

. 2 1 p"'!;,?" 5 ” ^ dl “ U '“ expressing such signals 
6.2-3 Find the .averse Laplace transforms of the following functions: 

c . (2s + 5)e~ 2 * e ~(«-r) . o 


s 2 + 5s + 6 


a e-^ + 3 

s 2 - 2s + 5 
1 + e -25 + 1 


°’- 4 -* 

(a) If the Laplace transform of fit) in Fig P6 2 4a is u 

Laplace transform of g(t) [Fig. P6.2-4b], Is ( ) ' the " Sh ° W that G ( s )' 


G « = 

1 — e~ sT o 


Res > 0 
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Fig. P6.2-4 


(b) Using this result, find the Laplace transform of the signal p(t) illustrated in Fig. 
P6.2-4c. 

Hint: l + x + x' 2 + x 3 + --- = ^ for |a| < 1. 

.2-5 Starting only with the fact that 6(t) <=> 1, build Pairs 2 through 10b in Table 6.1, 
using various properties of the Laplace transform. Hint: u(t) is the integral of S(t), 
tu(t) is integral of u(t) [or second integral of 5(t)], and so on. 

.2-6 (a) Find the Laplace transform of the pulses in Fig. 6.3 in the text by using only the 

time-differentiation property, time-shifting property, and the fact that S(t) <=> 1. 
(b) In Example 6.7, the Laplace transform of f(t) is found by finding the Laplace 
transform of d 2 f /dt 2 . Find the Laplace transform of fit) in that example by finding 
the Laplace transform of df /dt. 

Hint for part (b): df /dt can be expressed as a sum of step functions (delayed by 
various amounts) whose transforms can be determined readily. 

.3-1 Using the Laplace transform, solve the following differential equations: 

(a) (D 2 + 3D + 2) y(t) = Df(t ) if y(0“) = y(0" ) = 0 and f(t) = u(t) 

(b) (D 2 + iD + 4) y[t) = (D + 1 )/(f) if y(0") = 2, y((T) = 1 and f(t) = e -*u(t) 

(c) ( D 2 + 6D + 25) y(t) = (D + 2 )f(t) if y(0") = y(0“) = 1 and f(t) = 25u(t) 

.3-2 Solve the differential equations in Prob. 6.3-1 using the Laplace transform. In each 
case determine the zero-input and zero-state components of the solution. 

.3-3 Solve the following simultaneous differential equations using the Laplace transform, 
assuming all initial conditions to be zero and the input /(£) = u(t): 

( a ) (D + 3)yi(t)-2ya(t) = /(t) 

-2yi(t) + (2D + 4)y 2 (t) = 0 

(b) (D + 2)y 1 (t)-p + l)y a (t)=0 

- (D + l)yi(t) + (2D + 1 )y 2 (t) = /(<) 


Determine the transfer functions relating outputs yi(t) and y 2 ( t) to the input f[t). 
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Fig. P6.3-4 


“ srjsr .sasissr u - - — - * - - — 

(a) Write loop equations (in time domain) for t > 0. 

foundtnpirt (a y ^ ^ ^ takmS the th<3 Laplace transform of loop equations 
6 ‘ 3 ' 5 deSCrib6d ^ the f ° ,l0WinS dlff “ nations, find the 

(a) 5^ + n * +24y(t) = 5 ^ +3/(t) 

<b) =*■ * «■„ 3 g + rf +5 / ( „ 

ential equation" re” fUnCti ° nS ’ find the differ - 


(a) H(s) = 


s 2 + 3s + f 


(b) H(s) = - 
<} J 


s 2 + 3s + 5 
+ 8s 2 + 5s + 7 


(c) H(s) = — 1 + 7s + 2 

« 2 — 9a 4- K 


~ V °' s z -2s + 5 
6.3-7 For a system with transfer function 


H{s) = — - 

s 2 + 5s + 6 

(a) Find the (zero-state) response if the input f(t ) is: 

(ii) (Hi) -5) (i.) <„) 

Lw 7(,, ,l * a. output ,(,) ,0 

6.3- 8 Repeat Prob. 6.3-7 if 

if(s) = — - s + 3 _ 
s 2 + 2s + 5 

and the input f(t) is: (a) 10u(t) (b) u(t - 5). 

6.3- 9 Repeat Prob, 6.3-7 if 

H( S ) = - * 

a* 4. Q 


and the input f(t) = (1 - e -‘) u ( t ) 
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3-10 For an LTIC system with zero initial conditions (system initially in zero state), if an 
input f(t) produces an output y(t ) , then show that: 

(a) the input df/dt produces an output dy/dt, and 

(b) the input f‘ f(r) dr produces an output f‘ y(r) dr. Hence, show that the unit 
step response of a system is an integral of the impulse response; that is, f 0 h(r ) dr. 


lfl 1H 



Fig. P0.4-2 


y(t) 



Fig. P6.4-3 


6.4- 1 Find the zero-state response v 0 (t) of the network in Fig. P6.4-1 if the input voltage 

f( t ) _ Find the transfer function relating the output i>o(t) to the input 

/(t). From the transfer function, write the differential equation relating vo(t) to f(t). 

6.4- 2 The switch in the circuit of Fig. P6.4-2 is closed for a long time and then opened 

instantaneously at t = 0. Find and sketch the current y(t) 

6.4- 3 Find the current y(t) for the parallel resonant circuit in Fig. P6.4-3 if the input is 

(a) f(t) — A cos uiotu(t) 2 i 

Yn 

(b) f(t) = A sin uiotu{t) 


Assume all initial conditions to be zero. 
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in 

Fig. P6.4-5 



Fig. P6.4-6 


6.4- 4 Find the loop currents yi(4) and y 2 (t) for t > 0 in the circuit of Fig. P6.4-4a for the 

input f(t) in Fig. P6.4-4b. 

6.4- 5 For the network in Fig. P6.4-5 the switch is in a closed position for a long time before 

t = 0, when it is opened instantaneously. Find yi (t) and v s (t) for t > 0. 

6.4- 6 Find the output voltage v 0 {t) for t > 0 for the circuit in Fig. P6.4-6, if the input 

/(f) = 100u(t). The system is in zero state initially. 

6.4- 7 Find the output voltage v 0 (t) for the network in Fig. P6.4-7 if the initial conditions 

are fz,( 0) = 1 A and vc(0) = 3 V. (Hint: Use the parallel form of initial condition 
generators.) 

6.4- 8 For the network in Fig. P6.4-8, the switch is in position a for a long time and then is 

moved to position b instantaneously at t = 0. Determine the current y{t) for t > 0. 
Hint: Use the Thevenin equivalent. 



466 


6 Continuous-Time System Analysis Using the Laplace Transform 


1/8 £1 



Fig. P6.4-7 


t=o ' /5 yU) 2Cl 20 



Fig. P6.4-8 


R C 



Fig. P6.4-9 
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Fig. P6.4-10 


and the input (a) u(t) (b) e~*u{t). 

6.5-1 Figure P6.5-la shows two resistive ladder segments. The transfer function of each 
segment (ratio of output to input voltage) is i. Figure P6.5-lb shows these two 
segments connected in cascade. 

(a) Is the transfer function (ratio of output to input voltage) of this cascaded network 

( 2 K 2 ) ~ 4* 

(b) If your answer is affirmative, verify the answer by direct computation of the 
transfer function. Does this computation confirm the earlier value 4? If not why? 

(c) Repeat the problem with As = A 4 = 200. Does this result suggest the answer to 
the problem in part (b)? 



(a) 


Fig. P6.5-1 


(b) 


.5-2 In Fig. 6.18, hi(t) and h 2 (t) are the impulse responses of systems with transfer func- 
tions Hi(s) and H 2 (s), respectively. Determine the impulse response of the cascade 
and parallel combination of Afys) and H 2 {s) shown in Fig. 6.18b and c. 

6.6- 1 Realize 

H(s) = + 

(s + l)(s + 3)(s + 4) 
by canonical, series, and parallel forms, 

6.6- 2 Repeat Problem 6.6-1 if 

(a) H(s) = 7 M s + 2 ) 

(s + l)(s 2 + 2s + 2) 

(b) H{s) = HiLhi 

(s + 2)(s 2 + 4) 

6.6- 3 Repeat Problem 6.6-1 if 


A(s) = 


5s(s + 2) 2 (s + 3) 
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YU) 



Fig. P6.6-7 


6.6-4 


Hint: Normalize the highest-power coefficient in the denominator to unity. 
Repeat Problem 6.6-1 if 


H(s) 


s(s + l)(s + 2) 

( s + 5 )(s + 6)(s + 8) 


Hint: Here m = n = 3. 

6.6-5 Repeat Problem 6.6-1 if 

s 3 

(s + l) 2 (s + 2)(s + 3) 


6.6-6 Repeat Problem 6.6-1 if 


H(S > ~ (s + l)(s 2 + 4s + 13) 

In this problem we show how a pair of complex conjugate poles may be realized using 
a cascade of two first-order transfer functions. Show that the transfer functio 
the block diagrams in Figs. P6.6-7a and b are 
1 1 

(a) H(s) - ( s + fl )2 + (,2 s 2 + 2as + (a 2 + b 2 ) 

s + a s + a 

(b) H(s) = ( s + a )2 + b 2 ~ s 2 + 2os + (a 2 + b 2 ) 

Hence, show that the transfer function of the block diagram m Fig. P6.6-7c is 

As + B _ As + B 

(c) H(s) - + Q )2 + (,2 _ s 2 + 2as + (a 2 + 6 2 ) 

Show op amp realization of the following transfer functions: 

-10 , , 10 ,..., s + 2 

<» — 5 (W 77 ! <m) 777 
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6.6- 9 Show two different op amp circuit realizations of the transfer function 

* {s) = £± 2 = 1 __ 3 _ 

' s + 5 s + 5 

6.6- 10 Show op amp canonical realization of the transfer function 


H(s) = - 35 + 7 — 
s 2 + 4s + 10 

6.6-11 Show op amp canonical realization of the transfer function 




s 2 + 5s + 2 
s 2 + 4s + 13 


6-7-Y Determine the rise time t r , the settling time t B} the PO, and the steady-state errors 
e s , e r , and e p for each of the following systems, whose transfer functions are: 


s 2 + 3s + 9 


s 2 -(- 3s + 4 


s 2 + 10s + 100 


F(s) 


, ( 


A 1 

I 



Fig. P6.7-2 

6.7-2 For a position control system depicted in Fig. P6.7-2, the unit step response shows 
the peak time t p = rr/4, the PO = 9%, and the steady-state value of the output for 
the unit step input is y 3e = 2. Determine Ki, K 2 and a. 


Kj 






mXfMum 

H 


■ 

Hi 



Fig. P6.7-3 

6.7- 3 For a position control system illustrated in Fig. P6.7-3 the following specifications 

are imposed: t r < 0.3, t s < 1, PO < 30% and e s — 0. Which of these specifications 
cannot be met by the system for any value of K? Which specifications can be met 
by simple adjustment of K? 

6.7- 4 Open loop transfer functions of four closed-loop systems are given below. In each 

case, give a rough sketch of the root locus. 


K(s+ 1) 
s(s + 3)(s + 5) 

K(s + 1) 

s(s + 3)(s + 5)(s + 7) 


K(s + 5) 
s(s + 3) 

K(s+ 1) 

s(s + 4)(s 2 + 2s + 2) 
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Fig. P6.7-5 


6 7-5 For a unity feedback system shown in Fig. P6.7-5, We are required to meet the 
specifications PO < 16%, U < 0.2, t, < 0.5, e a = 0 and e r < 0.06. Is it possible 
to meet these specifications just by adjusting A? If not, suggest a suitable form of 
compensator and find the resulting PO, t a , t r ,e 3 and e r . 

6.8- 1 Find the region of convergence, if it exists, of the (bilateral) Laplace transform of the 

following signals: 

i 1 _n 2 

(a) e-“> (b) (c) ^ <d) ^ (e) 

6.8- 2 Find the (bilateral) Laplace transform and the corresponding region of convergence 

for the following signals: 

(a) e -1 * 1 (b) e ' 1 * 1 cos t (c) e‘u(t) + e 2 t u(-t) 

(d) (e) e tu<_,) (f) cos wotu(t) + e* “(-*) 


6.8-3 Find the inverse (bilateral) Laplace transforms of the following functions. 


2s + 5 

W (s + 2)(s + 3) 

- 3 < a < -2 

fn 2s - 5 
(s - 2)(s - 3) 

2 < 0 < 3 

2 s + 3 

W (s + l)(s + 2 ) 

a > -1 

2 s + 3 

(s + l)(s + 2 ) 

a < —2 

3s 2 — 2 s — 17 

— — 1 < a 

( ) (s + l)(s + 3)(s - 

5) 

Find 



2 s 2 - 2 s - 6 

C |_(s + l)(s-l)(s + 2) 

if the region of convergence is (a) Re s > 1 (b) Re s < -2 
(c) -1 < Re s < 1 (d) -2 < Re s < -1 

6.8-5 For a causal LTIC system having a transfer function H(«) = 771 find the output y(t) 
if the input f(t) is given by 


(a) e-'* l/2 

(b) e‘u(t) + e 2t u(—t) 

(c) e _t/2 u(t) + e"‘ /4 u(-t) 


(d) e 2l u(t) + e u{—t) 

(e) e _£ ' / 4 n(t) + e t ^ 2 u(~ t) 

(f) e~ 3t u(t) + e~ 2t u(—t) 


Frequency Response and 
Analog Filters 


Filtering is an important area of signal processing. We have already discusse 
ideal filters in Chapter 4. In this chapter, we shall discuss the practical filter chai 
acteristics and their design. Filtering characteristics of a filter are indicated by it 
response to sinusoids of various frequencies varying from 0 to 00 . Such character 
istics are called the frequency response of the filter. Let us start with determinin 
the frequency response of an LTIC system. 

Recall that for h(t), we use the notation H(ui) for its Fourier transform am 
H (s) for its Laplace transform. Also, when the system is causal and asymptoticall; 
stable, all the poles of H(s) lie in the LHP. Hence, the region of convergence for H(s 
includes the jw axis, and we can obtain the Fourier transform H( u) by substitute 
s - 3 W in the corresponding Laplace transform H{s) (see P. 370). Therefore, H(ju 
and H(u>) represent the same entity when the system is asymptotically stable. Ii 
this and later chapters, we shall often find it convenient to use the notation H(ju) 
instead of H(iv). v 

7.1 Frequency Response of an LTIC System 

In this section we find the system response to sinusoidal inputs. In Sec. 2.4-3 w« 
showed that an LTIC system response to an everlasting exponential input /(t) = e s< 
is also an everlasting exponential H(s)e 3t . As before, we represent an input-output 
pair using an arrow directed from the input to the output as 

e st =► H(s)e 3t ( 7 .!) 

Setting s = ±jui in this relationship yields 

e** =► HWe** (7.2a) 

e Jut ==> (7.2b) 

Addition of these two relationships yields 

2 cos ut=>H = 2Re [H(jw)e iut ] (7.3) 
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We can express H(ju) in the polar form as 

H(jbj) = \H(ju)\eJ LH{ ^ (7.4) 

With this result, the relationship (7.3) becomes 

cos bit =► |ff(ju>)|cos [bit + 

In other words, the system response y(t) to a sinusoidal input cos u it is given by 

y(t) = |/f(jui)|cos [bit + /.H(ju)] (7.5a) 

Using a similar argument, we can show that the system response to a sinusoid 
cos (i bit + 9) is 

y(t) = |R(jai)| cos [bit + 6 + /.H(jbi)] (7.5b) 

This result, where we have let s = jui, is valid only for asymptotically stable systems 
because the relationship (7.1) applies only for the values of s lying in the region of 
convergence for H{s). For the case of unstable and marginally stable systems, this 
region does not include the imaginary axis s = jui (see also the footnote on p. 243). 

Equation (7.5) shows that for a sinusoidal input of radian frequency w, the 
system response is also a sinusoid of the same frequency ui. The amplitude of the 
output sinusoid is |.ff(jw)| times the input amplitude, and the phase of the output 
sinusoid is shifted by lH(ju) with respect to the input phase (see Fig. 7.1). For 
instance, if a certain system has |R(jlO)| = 3 and /.H(jlO) = -30°, then the system 
amplifies a sinusoid of frequency ui = 10 by a factor of 3 and delays its phase by 30°. 
The system response to an input 5 cos (lOt + 50°) is 3 x 5 cos (lOt + 50° - 30°) = 
15 cos (lOt + 20°). 

Clearly \If{jbi)\ is the system gain, and a plot of |R(jui)| versus ui shows the 
system gain as a function of frequency ui . This function is more commonly known as 
the amplitude response. Similarly, LHiju) is the phase response and a plot of 
/-H(jui) versus ui shows how the system modifies or changes the phase of the input 
sinusoid. These two plots together, as functions of w, are called the frequency 
response of the system. Observe that H(jui) has the information of \H(ju)\ and 
IH(jbi). For this reason, H(ju) is also called the frequency response of the 
system. The frequency response plots show at a glance how a system responds to 
sinusoids of various frequencies. Thus, the frequency response of a system represents 
its filtering characteristic. 


U Example 7.1 

Find the frequency response (amplitude and phase response) of a system whose tran: 
fer function is 


Also, find the sy 
In this case 


the system response y(t ) if the input f(t) is (a) cos 2 1 (b) cos (lOt — 50 ). 


TTC ' + 

H{JU) = ~JJ+T 


juj ~r o 

Recall that the magnitude of a complex number is equal to the square 
the squares of its real and imaginary parts. Hence 


root of the sum 


= and ^Cj«) = t «“ 1 (sT)- t “' l (|) 



Fig. 7.1 Frequency response of an LTIC system in Example 7.1. 



Both the amplitude and the phase response are depicted in Fig. 
These plots furnish the complete information about the frequency 
to sinusoidal inputs. 

(a) For the input }(t) = cos 2 1, ui - 2, and 


7.1a as functions of 
response of the system 


mm = 


/( 2) 2 + 0.0 1 

\J (2) 2 + 25 


lH{ j 2) - tan 1 ) - tan 1 = 87.1° - 21.8° = 65.3° 

Fie T^a^ 0 C ° Uld , h3Ve read these values direc % from the frequency response plots in 
fig. 7.1a corresponding to u> = 2. This result m MTie fw • . , , p m 

freouenrvn >. o Q , . 7 , means that for a sinusoidal input with 

equency u - 2 the amplitude gam of the system is 0.372, and the phase shift is 65 3° 
In other words, the output amplitude is 0.372 times the input amplitude and the phase 

of the output is shifted with respect to that of the input by 65.3°. Therefore the system 
response to an input cos 2i is nereiore, tne system 

1/(0 = 0.372 cos (2t + 65.3°) 

frated n fn Ut Fig OS 7 2 lb. nd ^ C ° rreSp ° nding system res P onse 0.372 cos (2t + 65.34°) are illus- 
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(b) For the input cos (10t-50°), instead of computing the values \H{ju)\ and IH(juj) 
as in part (a), we shall read them directly from the frequency response plots in Fig. 7.1a 
corresponding to i a = 10. These are; 

1/7010)1 = 0.894 and IH(jlO) = 26° 

Therefore, for a sinusoidal input of frequency u = 10, the output sinusoid amplitude is 
0.894 times the input amplitude and the output sinusoid is shifted with respect to the 
input sinusoid by 26°. Therefore, y(t), the system response to an input cos (lOt - 50°), is 

y(t) = 0.894 cos (10/ - 50° + 26°) = 0.894 cos (lOf - 24°) 

If the input were sin(10t - 50°), the response would be 0.894sin(10t - 50° + 26°) = 
0.894 sin (lOt - 24°). 

The frequency response plots in Fig. 7.1a show that the system has highpass filtering 
characteristics; it responds well to sinusoids of higher frequencies (ui well above 5), and 
suppresses sinusoids of lower frequencies (w well below 5). I 


o 


Computer Example C7.1 

Plot the frequency response of the transfer functions H(s) = 

num=[l 5]; 
den=[l 3 2]; 
w=.l:. 01:100; 

axis([loglO(.l) loglO(lOO) -50 50]) 

[mag, phase, w] =bode(num, den, w) ; 
subplot (211 ),semilogx(w,20*logl0(mag)) 
subplot(212),semilogx(w, phase) Q 



I Example 7.2 

Find and sketch the frequency response (amplitude and phase response) for 

(a) an ideal delay of T seconds; 

(b) an ideal differentiator; 

(c) an ideal integrator. 


(a) Ideal delay of T seconds: The transfer function of an ideal delay is [see Eq. 
(6.54)1 

H(s) = e~ sT 

Therefore 


H(ju) = e~ iuT 

Consequently 

|Zf (ju/)| = 1 and /.H(ju) = -uT (7.6) 

This amplitude and phase response is shown in Fig. 7.2a. The amplitude response is 
constant (unity) for all frequencies. The phase shift increases linearly with frequency with 
a slope of — T . This result can be explained physically by recognizing that if a sinusoid 
cos uit is passed through an ideal delay of T seconds, the output is cos ui(t - T). The 
output sinusoid amplitude is the same as that of the input for all values of ui. Therefore, the 
amplitude response (gain) is unity for all frequencies. Moreover, the output cos ui(t — T) — 
cos (uit - u >T) has a phase shift -uT with respect to the input cos uit. Therefore, the phase 
response is linearly proportional to the frequency ui with a slope —T. 


(b) An ideal differentiator: The transfer function of an ideal differentiator is [see 
Eq. (6.55)] 

H{s) - s 

Therefore 

H(ju) = jui = a. | e/ 1T/2 


7.1 Frequency Response of an LTIC System 
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Ideal Delay Ideal Differentjator I dea l Integrator 



Fig. 7.2 Frequency response of an ideal (a) delay (b) differentiator (c) integrator. 


Consequently 

!*(**’) I=“ a nd iH{ju) = § (7 7) 

lAcreaa^linearly^kh'frwmency'^and < ^ e ' D ' cte4 ^ 7 -*b. The amplitude response 
This result can be W ^ 

through an tdeal differentiator, the output is -Lin It = u, cos (““ ) ^ f ^ 

i p tzr:h that L the 

T PlitUde reSP ° nSe (Sain) fa Phonal *0 frequency 

ah ULitrLt (see K Fig - 7 - 2b) - 

(rapidly varying) signal containing components of very Mgh frequencies A diffLn't L 

~etnL^ 


(6.56)] C) An id6aI int6grat0r: The function of an ideal integrator is [see Eq. 

H( S ) = I 

s 


Therefore 


Consequently 


H(joj) = ~ = — Z — i.g-JTr/2 

jbJ U) U) 


\ H (jv)\ = - and lH(jui) = -~ 


This amplitude and phase response is illustrated in Fig 7 2c The 
.v™„ proportional a, fr^onc* and , h , ph », 
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This result can be explained physically by recognizing that if a sinusoid cos u>t is passed 
through an ideal integrator, the output is £ sin u>£ = ^cos(u>t — f )■ Therefore, the 
amplitude response is inversely proportional to u>, and the phase response is constant 
( — 7r / 2) with frequency. 

Because its gain is l/u>, the ideal integrator suppresses higher-frequency components 
but enhances lower-frequency components with u < 1. Consequently, noise signals (if they 
do not contain an appreciable amount of very low frequency components) are suppressed 
(smoothed out) by an integrator. I 
A Exercise E7.1 

Find the response of an LTIC system specified by 




if the input is a sinusoid 20 sin (3t - 


Answer: 10.23 sin (3t — 61.91°) V 


7.1-1 Steady-State Response to Causal Sinusoidal Inputs 

So far we discussed the LTIC system response to everlasting sinusoidal inputs 
(starting at f = — oo). In practice, we are more interested in causal sinusoidal inputs 
(sinusoids starting at t = 0). Consider the input e JlJf u(i), which starts at t = 0 
rather than at t = -oo. In this case F(s) = 1 /{a + jw). Moreover, according to 
Eq. (6.51) H(s) = P(s)/Q(s), where Q(s) is the characteristic polynomial given by 
Q(s) — (s - A,)(s - A 2 ) • • • (s - A n ). Hence, 


y(s) F(s)H(s) {s _ Xi){s _ Aa) ... (s _ An ) (s _j u) 

In the partial fraction expansion of the right-hand side, let the coefficients cor- 
responding to the n terms ( s - A,), (s - A 2 ) • • • (s - A n ) be ki, fc 2 , • • ■ k n . The 
coefficient corresponding to the last term (s - ju>) is P(«)/Q(*)l»=ju> = ff(jui). 
Hence, 

y(.) = + 

A-f ft — \ - ft — 


y(t) = y>e A ‘M0 + if (ju>)e 2Ut u(t) (7.9) 

i=l S v ' 

^ y ^ steady-state component y aa (t) 

transient component y tr (i) 

For an asymptotically stable system, the characteristic mode terms e Xit decay with 
time, and, therefore, constitute the so-called transient component of the response. 
The last term H(jw)e Jwt persists forever, and is the steady-state component of 
the response given by 

y„(t) = HU»)e jut u(t) 

From the argument that led to Eq. (7.5a), it follows that for a causal sinusoidal 
input cos u>t, the steady-state response y ss {t) is given by 


Vas(t) = Iff (jw)| cos [ut + lH(ju)]u{t) (7.10) 

In summary, \H (jtu)\ cos [wt + LH (ju)] is the total response to everlasting sinusoid 
cos Lot, and is also the steady-state response to the same input applied at t = 0. 


7.2 Bode Plots 
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7.2 Bode Plots 

Sketching frequency response plots is considerably facilitated by the use of 
logarithmic scales. The amplitude and phase response plots as a function of u on a 
ogarithmic scale are known as the Bode plots. By using the asymptotic behavior 
of the amplitude and the phase response, we can sketch these plots with remarkable 
ease, even for higher-order transfer functions. 

Let us consider a system with the transfer function 


ff(s) = 


K(s + ai)(s + a 2 ) 
s(s + 6i)(s 2 4- 6 2 s + t 3 ) 


(7.11a) 


where the second-order factor (s 2 + 6 2 s + fe 3 ) is assumed to have complex conjugate 
roots. We shall rearrange Eq. (7.11a) in the form 


»(«) = 


U +1 iu +1 J 

t (i +1 )(k + h a+1 . 


(7.11b) 


H(ju) = 


x + tL\( 1 + tL 


\ b i ) h b 3 


This equation shows that H(jio) is a complex function of u. The amplitude response 
\H\jui)\ and the phase response /.H(ju') are given by 


\H(ju)\ = ■ 


„ 1 + ^ 1 + ^ 

K Q iQ2 d\ a 2 

»i 03 63 


(7.12a) 




From Eq. (7,12b) we see that the phase function consists of the addition of only 
three kinds of terms: (i) the phase of ju, which is 90° for all values of w, (ii) 

the phase for the first-order term of the form 1 + — , and (iii) the phase of the 
second-order term “ 


1 + 1 + CM!' 

h h 


We can plot these three basic phase functions for u in the range 0 to 00 and then, 
using these plots, we can construct the phase function of any transfer by properly 
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adding these basic responses. Note that if a particular term is in the numerator, its 
phase is added, but if the term is in the denominator, its phase is subtracted. This 
makes it easy to plot the phase function lH{ju) as a function of oj. Computation 
of \H(ju)\, unlike that of the phase function, however, involves the multiplication 
and division of various terms. This is a formidable task, especially when we have 
to plot this function for the entire range of ui (0 to oo). 

We know that a log operation converts multiplication and division to addition 
and subtraction. So, instead of plotting |ff(jaj)|, why not plot log \H(juj)\ to 
simplify our task? We can take advantage of the fact that logarithmic units are 
desirable in several applications, where the variables considered have a very large 
range of variation. This is particularly true in frequency response plots, where we 
may have to plot frequency response over a frequency range starting from a very low 
frequency near 0 to a very high frequency in the range of 10 10 or higher. A linear plot 
for such a large range will bury much of the useful information. Also, the amplitude 
response may have a very large dynamic range from a low of 10 -6 to a high of 10 6 . 
A linear plot would be unsuitable for such a situation. Therefore, logarithmic plots 
not only simplify our task of plotting, but, fortunately, they are also desirable in 
this situation. The logarithmic unit is the decibel and is equal to twenty times the 
logarithm of the quantity (log to the base 10). Therefore, 201og 10 \H(ju)\ is simply 
the log amplitude in decibels (dB). Thus, instead of plotting |R(jw)|, we shall plot 
201og 10 \H(jui)\ as a function of u. These plots (log amplitude and phase) are called 
Bode plots. For the transfer function in Eq. (7.12a), the log amplitude is 

20 log |H(jw)| = 20 log ^ 2222 . + 20 log 1 + — +201ogl + ^ -201og|jw| 
0163 ai 02 

- 20 log 1 + 7^- 20 log 1 + ^ + tip- (7.13) 

or 03 03 

The term 20 \og{K 010.2/ b\b 3 ) is a constant. We observe that the log amplitude is 
a sum of four basic terms corresponding to (i) a constant, (ii) a pole or zero at 
the origin (20 log |ju>|), (iii) a first-order pole or zero (20 log 1 1 + ju)/a |), and (iv) 
complex conjugate poles or zeros (20 log j 1 + juibi/b^ + (ju) 2 /b 3 \). We can sketch 
these four basic terms as functions of u and use them to construct the log-amplitude 
plot of any desired transfer function. Let us discuss each of the terms. 

1. Constant ka\a 2 /b\b 3 

The log amplitude of this term is also a constant, 201og(Ra 1 a2/f’il>3). The 
phase contribution from this term is zero. 

2. Pole (or Zero) at the origin 
Log Magnitude 

Such a pole gives rise to the term —20 log |jw|, which can be expressed as 
— 201og|jui| = -20 logu 



Fig. 7.3 Amplitude and phase response of a pole or a zero at the origin. 

f This point can be shown as follows: Let uj\ and u .<2 along the w-scale correspond to ui and 112 
along the u-scale. Then logon = ui, and loga) 2 = u 2 . Then 

ThuSi if u 2 - ui = log l0 w 2 - log 10 wi = log 10 (w 2 / Wl ) 

( 012 / 011 ) = 10 (which is a decade) 

and if n 2 - U1 = log 10 10 = 1 

(^ 2 /^ 1 ) = 2 (which is an octave) 
u 2 -ui = log 10 2 — 0.3010 
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Note that equal increments in u are equivalent to equal ratios on the iv-scale. Thus, 
one unit along the u-scale is the same as one decade along the tv-scale. This means 
that the amplitude plot has a slope of -20 dB/decade or -20(0.3010) = -6.02 
dB/octave (commonly stated as 6 dB/octave). Moreover, the amplitude plot crosses 
the tv-axis at tv = 1, since u = log 10 tv = 0 when tv = 1. 

For the case of a zero at the origin, the log-amplitude term is 20 log tv. This 
is a straight line passing through u = 1 and having a slope of 20 dB/decade (or 6 
dB/octave). This plot is a mirror image about the tv-axis of the plot for a pole at 
the origin and is shown dotted in Fig. 7.3a. 

Phase 

The phase function corresponding to the pole at the origin is - lju [see Eq. 
(7.12b)]. Thus 

lH(ju) = -ijui = -90° (7.15b) 

The phase is constant (-90°) for all values of tv, as depicted in Fig. 7.3b. For a 
zero at the origin, the phase is Ljw = 90°. This is a mirror image of the phase plot 
for a pole at the origin and is shown dotted in Fig. 7.3b. 

3. First-Order Pole (or Zero) 

The Log Magnitude 

The log amplitude because of a first-order pole at -a is -20 log 1 + — . Let 

a 

us investigate the asymptotic behavior of this function for extreme values of tv 
(tv a and tv » a). 

(a) For tv < a, 

-201og 1 + ^ ss -20 log 1 = 0 (7.16) 

Hence, the log-amplitude function — * 0 asymptotically for tv < a (Fig 

(b) For the other extreme case, where tv » a, 

—20 log 1 + “ »-201og^ 

= -20 log tv + 20 log a 
= -20u + 20 log a 

This represents a straight line (when plotted as a function of u, the log of tv) with 
a slope of —20 dB/decade (or —6 dB/octave). When tv = a, the log amplitude is 
zero [Eq. (7.17b)]. Hence, this line crosses the tv-axis at tv = a, as illustrated in Fig. 
7.4a. Note that the asymptotes in (a) and (b) meet at tv = a. 

The exact log amplitude for this pole is 

-20 log 1 + — =-201og(l + ^V 
a \ a* J 

= — 101 og (l + ^) 


. 7.4a). 

(7.17a) 

(7.17b) 


(7.18) 


20 log I // 1, dB 



Fig. 7.4 Amplitude and phase response of a first-order pole or zero. 


clot and th “ f “ Ctl0n als ° appears in Fi S' 7 - 4a - Observe that the actual 

plot and the asymptotic plots are very close. A maximum error of 3 dB occurs at 

The errJ hlS kl “ Wn “ the COrner fre quency or break frequency. 

shown n F Tg r 7t e Th fi ,S 3 dB ‘ A pI °‘ ° f the error as a f ”-tion of tv is 

hown m Fig. 7.5a. This figure shows that the error at one octave above or below 

frequency is' oTdB Th *“1 6rr0r f ‘ W ° ° CtaVeS ab0Ve ° P bd ° W the Corner 
SXSe Plot P '“ " be 0b, *‘“ <l b? « "» 

.o tJ t h „/r!:rr p T, ,or * t m -• <,h ° w " ^ ^ 

LT r i , W a SIgn Change ’ and therefore is the image (about 
the 0-dB line) of the amplitude plot for a pole at -a. 

Phase 

The phase for the first-order pole at -a is 


Phase error, degrees — ► Error, db 
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0.01a 0.05a 0.1a 0.5a a 5a 10a 50a 100a 


Fig. 7.5 Errors in asymptotic approximation of a first-order pole. 


/-H(ju) = -L ^1 -f — ^ = - tan -1 ^ 

Let us investigate the asymptotic behavior of this function. For u> < a, 


and, for u a, 



The actual plot along with the asymptotes is depicted in Fig. 7.4b. In this case, we 
use a three-line segment asymptotic plot for greater accuracy. The asymptotes are 
(i) a phase angle of 0° for u < o/lO, (ii) a phase angle of -90° for u > 10a, and 
a straight line with a slope —45° /decade connecting these two asymptotes (from 
u> = a/10 to 10a) crossing the u> axis at u = a/10. It can be seen from Fig. 7.4b 
that the asymptotes are very close to the curve and the maximum error is 5.7°. A 
plot of the error as a function of u; is illustrated in Fig. 7.5b. The actual plot can 
be obtained by adding the error to the asymptotic plot. The phase function for a 
pole at —a is shown in Fig. 7.4b. The phase for a zero at —a (shown dotted in Fig. 


7.2 Bode Plots 
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™ b l 1S ldent, ^ a i t0 tha * of the pole at -a with a sign change, and therefore is the 
mirror image (about the 0 line) of the phase plot for a pole at -a. 

4. Second-Order Pole (or Zero) 

2 , . Le ‘ f C r id u r „ the second -° rder P° le in Eq. (7.11a). The denominator term is 

of t'+t w Vwu T the 0ften - USed Standard form * 2 +2C^+<4 instead 

■ ,he ioe “ p, “ e the 


and the phase function is 


The Log Magnitude 


-20 log 1 + 2 K-+1 3 — 


-/ 1 + 2K— + 


(7.19a) 


(7.19b) 


The log amplitude is given by 


log amplitude = -20 log 1 + 2j( 


For ui <<c u> n , the log amplitude becomes 

log amplitude ss -20 log 1 = 0 
For u » u n , the log amplitude is 


log amplitude ss -20 log ( - 


= -40 log 


— -401ogca - 401ogu; n 
= — 40u - 401ogw n 


(7.22b) 

(7.22c) 


The two asymptotes are (i) zero for « < Wn , and (ii) -40 a - 401oga; n for w > 
.R h , 6 S f eC °” d “ ymptote is a strai § ht lina with a slope of -40 dB/decade (or 
W P againS ‘ the l0g w ScaIe - U be S ins at ca = [see Eq. 

srs z&ssr " ln Fis ' 7 ' 6 * Tie “ ,oe *” pii,ude “ 


log amplitude = -20 log < 1 


+ 4 C 2 - 


Clearly, the log amplitude m this case involves a parameter C- For each value of 

il?b haV f e adlffe J ent plot ; For com P lex conjugate poles, f C < 1. Hence, we must 
ske ch a family of curves for a number of values of f in the range 0 to 1. This 
is illustrated in Fig. 7.6a. The error between the actual plot and the asymptotes 



20 log I H I, dB 


484 7 Frequency Response and Analog Filters 




0.1o>„ 0.2to„ 0.5(o n 0)„ 2(0 n 5cd„ 10o)„ 

Fig. 7.6 Amplitude and phase response of a second-order pole. 

is shown in Fig. 7.7. The actual plot can be obtained by adding the error to the 
asymptotic plot. 

For second-order zeros (complex conjugate zeros), the plots are mirror images 
(about the 0-dB line) of the plots depicted in Fig. 7.6a. Note the resonance phe- 
nomenon of the complex conjugate poles. This phenomenon is barely noticeable for 
( > 0.707 but becomes pronounced as C — > 0. 

Phase 

The phase function for second-order poles, as apparent in Eq. (7.19b), is 


Phase error, degrees Error , db 


7.2 Bode Plots 


1 / 

0.707^ 

i= d£ 


0.5to„ <o=o>„ 



Fig. 7.7 Errors in the asymptotic approximation of a second-order pole. 


For u < 


For u » ui n , 


LH (ju) = - tan 1 2C ( — 


IH(ju) « 0 


1 - - 


IH(ju) ce - 180° 


Hence, the phase —> -180° as u> — > oo. As in the case of amplitude, we also have a 
family of phase plots for various values of (, as illustrated in Fig. 7.6b. A convenient 
asymptote for the phase of complex conjugate poles is a step function that is 0° for 
w < u n and -180° for to > u„. An error plot for such an asymptote is shown in 
Fig. 7.7 for various values of (. The exact phase is the asymptotic value plus the 




486 


7 Frequency Response and Analog Filters 


For complex conjugate zeros, the amplitude and phase plots are mirror images 
of those for complex conjugate poles. We shall demonstrate the application of these 
techniques with two examples. 


U Example 7.3 

Sketch the Bode plots for the transfer function 

20s(s + 100) 

W (» + 2)(* + 10) 

First, we write the transfer function in normalized form 


H-(s) 


20 x 100 « (1 + ife) _ *(l + I5o) 

2 x 10 ( 1 +|) (1 + *)" (1 + §)(! + *) 


(7.25) 


Here, the constant term is 100; that is, 40 dB (20 log 100 = 40). This term can be added 
to the plot by simply relabeling the horizontal axis (from where the asymptotes begin) as 
the 40 dB line (see Fig. 7.8a). Such a step implies shifting the horizontal axis upward by 
40 dB. This is precisely what is desired. 

In addition, we have two first-order poles at —2 and —10, one zero at the origin, and 
one zero at -100. 

Step 1. For each of these terms, we draw an asymptotic plot as follows (see Fig. 
7.8a): 

(i) For the zero at the origin draw a straight line with a slope of 20 dB/decade passing 
through u> = 1. 

(ii) For the pole at -2, draw a straight line with a slope of -20 dB/decade (for u> > 2) 
beginning at the corner frequency w = 2. 

(iii) For the pole at -10, draw a straight line with a slope of -20 dB/decade beginning 
at the corner frequency u = 10. 

(iv) For the zero at -100, draw a straight line with a slope of 20 dB/decade beginning 
at the corner frequency u = 100. 

Step 2. Add all the asymptotes, as depicted in Fig. 7.8a. 

Step 3. Apply the following corrections (see Fig. 7.5a): 

(i) The correction at u = 1 because of the corner frequency at u = 2 is -1 dB. The 
correction at u> = 1 because of the corner frequencies at o> = 10 and u = 100 are quite 
small (see Fig. 7.5a) and may be ignored. Hence, the net correction at u = 1 is — 1 dB. 

(ii) The correction at = 2 because of the corner frequency at ui — 2 is —3 dB, 
and the correction because of the corner frequency at w = 10 is —0.17 dB. The correction 
because of the corner frequency u — 100 can be safely ignored. Hence the net correction 
at u = 2 is —3.17 dB. 

(iii) The correction at u> = 10 because of the corner frequency at w = 10 is —3 dB, 
and the correction because of the corner frequency at u = 2 is —0.17 dB. The correction 
because of ui = 100 is 0.04 dB and may be ignored. Hence the net correction at w = 10 is 
-3.17 dB. 

(iv) The correction at ui = 100 because of the corner frequency at u = 100 is 3 dB, 
and the corrections because of the other corner frequencies may be ignored. 

(v) The corrections at ui — 4 and u = 5 (because of corner frequencies at w = 2 and 
10) are found to be about -1.75 dB each. 

With these corrections, the resulting amplitude plot is illustrated in Fig. 7.8a. 


Phase Plots 


We draw the asymptotes corresponding to each of the four factors: 


7.2 Bode Plots 
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Fig. 7.8 Amplitude and phase response of the second-order system in Example 7.3. 


(i) The zero at the origin causes a 90° phase shift. 

(ii) The pole at s = -2 gives rise to a -45°/decade asymptote starting at ui = 0.2, 
which goes up to w = 20. For u < 0.2, the asymptote is 0°, and, for ui > 20, the asymptotic 
value is —90°. 

(iii) The pole at s = —10 has an asymptote with a zero value for — oo < ui < 1 and a 
slope of -45°/decade beginning at w = 1 and going up to u = 100. The asymptotic value 
for u > 100 is -90°. 

(iv) The zero at s = —100 gives rise to an asymptote with a 45° /decade slope, 
beginning at cu = 10 and going up to w = 1000. For u < 10, the asymptotic value is 0°, 
and, for u> > 1000, the asymptotic value is 90°. All the asymptotes are added, as shown 
in Fig. 7.8b. The appropriate corrections are applied from Fig. 7.5b, and the exact phase 
plot is depicted in Fig. 7.8b. I 
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■ Example 7.4 

Sketch the amplitude and phase response (Bode plots) for the transfer function 


H(s) 


10(s + 100) 
s 2 + 2s + 100 



(7.26) 


Here, the constant term is 10; that is, 20 dB (20 log 10 = 20). To add this term, we 
simply label the horizontal axis (from where the asymptotes begin) as the 20 dB line as 
before(see Fig. 7.9a). 

T- 1 


In addition, we have a real zero at s = -100 and a pair of complex conjugate poles. 
When we express the second-order factor in standard form, * 


s 2 + 2s + 100 = s 2 + 2£w„s + w 2 

we have 

= 10 and ( - 0.1 

Step 1. Draw an asymptote of -40 dB/decade (-12 dB/octave) starting at w = 10 
for the complex conjugate poles, and draw another asymptote of 20 dB/decade, starting 
at u) = 100 for the (real) zero. 

Step 2. Add both asymptotes. 

Step 3. Apply the correction at = 100, where the correction because of the corner 
frequency u = 100 is 3 dB. The correction because of the corner frequency u = 10 may be 
ignored. Next, apply the correction at w = 10, where the correction because of the corner 
frequency w = 10 is 13.90 dB (see Fig. 7.7a for < = 0.1 ). We may find corrections at a 
few more points. The resulting plot is illustrated in Fig. 7.9a. 


Phase Plot 


^The asymptote for the complex conjugate poles is a step function with a jump of 
-90° at u = 10, and the asymptote for the zero at s = -100 is a straight line with a slope 
of 45°/decade, leveling off at u = 10 and u = 100 to 0° and 90°, respectively. The two 
asymptotes add to give the sawtooth shown in Fig. 7.9b. We now apply the corrections 
from Fig. 7.7b and Fig. 7.5b to obtain the exact plot. H 

O Computer Example C7.2 

Solve Examples 7.3 and 7.4 using M-file functions in MATLAB. 

Frequency response may be plotted using several functions. For the purpose of Bode 
plots, however, the most suitable file is bode.m, which can be used as demonstrated here. 

% For Example 7.3 

num=[20 2000 0];den=[l 12 20]; 

bode(num,den) 

% For Example 7.4 

num=[0 10 1000];den=[l 2 100]; 

bode(num,den) Q 


Poles and Zeros in RHP 


In our discussion so far, we have assumed the poles and zeros of the transfer 
function to be in the LHP. What if some of the poles and/or zeros of H(s) lie in the 
RHP? If there is a pole in the RHP, the integral in Eq. (2.49) with s = ju does not 


Phase, degrees 
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. t h.TH?'Z"w “ PPliC **'°? F “ . « M consider only the 

o” .1 ^™n p ,™ t „^“ r.‘ Th“‘’" wde 'r ,on rhp 

a Lnr zero at -a. ihe reason is that 


1 + — = 1 
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whereas the phase of the LHP pole at s — -a is — tan _1 (a;/a). 

The complex conjugate zeros in RHP give rise to a term s 2 - 2(iv n s +uj, which 
is identical to the term s 2 + 2 Cw n s + “n with a sign change in Hence, from Eqs. 
(7.23) and (7.24) it follows that the amplitudes are identical, but the phases are of 
opposite signs for the two terms. 

7.2-1 The Transfer Function From the Frequency Response 

In the previous section we were given the transfer function of a system. From 
a knowledge of the transfer function, we developed techniques for determining the 
system response to sinusoidal inputs. We can also reverse the procedure to deter- 
mine the transfer function of a system if the system response to a sinusoidal input is 
known. This problem has significant practical utility. If we are given a system in a 
black box with only the input and output terminals available, the transfer function 
has to be determined by experimental measurements at the input and output ter- 
minals. The frequency response to sinusoidal inputs is one of the possibilities that 
is very attractive because of the simple nature of the measurements involved. One 
only needs to apply a sinusoidal signal at the input and observe the output. We find 
the amplitude gain | H (jm)| and the output phase shift /.H ( jw ) (with respect to the 
input sinusoid) for various values of ui over the entire range from 0 to oo. This in- 
formation yields the frequency response plots (Bode plots) when plotted against log 
ui. From these plots we determine the appropriate asymptotes by taking advantage 
of the fact that the slopes of all asymptotes must be multiples of ±20 dB/decade if 
the transfer function is a rational function (function which is not necessarily a ratio 
of two polynomials in s). From the asymptotes, the corner frequencies are obtained. 
Corner frequencies determine the poles and zeros of the transfer function. 


7.3 Control System Design Using Frequency Response 


Figure 7. 10a shows a basic closed-loop system, whose open-loop transfer func- 
tion (transfer function when the loop is opened) is KG(s)H(s). The closed-loop 
transfer function is [see Eq. (6.69) 


T(s) 


KG(s) 

1 + KG(s)H(s) 


The time-domain method of control system design discussed in Sec. 6.7 works only 
when the transfer function of the plant (the system to be controlled) is known and is 
a rational function (ratio of two polynomials in s). The input-output description of 
practical systems is often unknown and is more likely to be nonrational. A system 
containing an ideal time delay (dead time) is an example of a nonrational system. 
In such cases, we can determine the frequency response of the open-loop system 
empirically and use this data to design the (closed-loop) system. In this section 
we shall discuss feedback system design procedure based on frequency response 
description of a system. However, the frequency response design method is not as 
convenient as the time-domain design method from the viewpoint of the transient 
and the steady-state error specifications. Consequently, the time-domain method in 
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Sec. 6.7 and the frequency response method should be considered as complementary 
rather than as alternatives or as rivals. 

Frequency response information can be presented in a various forms of which 
Bode plot is one. The same information can be presented by the Nyquist plot" 
also known as the polar plot or by the Nichols plot also known as log-magnitude 
versus angle plot. Here, we shall discuss the techniques using Bode and Nyquist 
plots only. Figure 7.10b shows Bode plots for the open-loop transfer function 
ff/s(s + 2)(s + 4) when K = 24. The same information is presented in polar form in 
the corresponding Nyquist plot in Fig. 7.10c. For example, at u = 1, |f/(jw)| = 2.6 
and AH(jui) = —130.6°. We plot a point at a distance 2.6 units and at an angle 
-130.6° from the horizontal axis. This point is labeled as tv = 1 for identification 
(see Fig. 7.10c). We plot such points for several frequencies in the range from tv = 0 
to oo and draw a smooth curve through them to obtain the Nyquist plot. The same 
information is presented in Cartesian form in Nichols plot. For instance, at tv — 1, 
the log magnitude is 20 log 2.6 = 8.3 dB, and the phase at tv = 1 is -130.6°. We 
plot a point at coordinates x = 8.3, y — -130.6° and label this point as tv = 1 for 
identification. We do this for several values of tv from 0 to oo and draw a curve 
through these points to obtain Nichols plot. Using Bode or Nyquist (or Nichols) 
plots of the open-loop transfer function, we can readily investigate stability aspect 
of the corresponding closed-loop system as discussed below. 

7.3-1 Relative Stability: Gain and Phase margins 

For the system in Fig. 7.10a, the characteristic equation is 1 + KG(s)H(s) = 0 
and the characteristic roots are the roots of KG{s)H (a) = - 1 . The system becomes 
unstable when the root loci cross over to RHP. The crossing occurs on the imaginary 
axis where s = ju> (see Fig. 6.43). Hence, at the verge of instability (marginal 
stability) 

KG{ju)H(iuj) = -1 = 

Thus, at the verge of instability, the magnitude and angle of the open loop gain 
KG(ju)H(ju>) are 

\KG(jui)H — 1, and lG(ju)H(jio) = ±ir 

Thus, on the verge of instability, the open-loop transfer function has unity gain 
and phase of ±7r. In order to understand the significance of these conditions, let us 
consider the system in Fig. 7.10a, with open-loop transfer function A/s(s + 2)(s+4). 
The Bode plot for this transfer function (for K = 24) is depicted in Fig. 7.10b. The 
root locus for this system is illustrated in Fig. 6.43. The loci cross over to RHP 
for K > 48. For K < 48, the system is stable. Let us consider the case K — 24. 
Figure 7.10b shows Bode plots when K = 24. Let the frequency where the angle 
plot crosses -180° be tv p (the phase crossover frequency). Observe that at tv p , 
the gain is 0.5 or -6 dB. This shows that the gain K will have to double (to value 
48) to have unity gain, which is the verge of instability. For this reason we say that 
the system has a gain margin = 6 dB. On the other hand, if tv 9 is the frequency 
where the gain is unity or 0 dB, (the gain crossover frequency), then at this 
frequency, the open-loop phase is -157.5°. The phase will have to decrease from 
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this value to -180° before the system becomes unstable. Thus, the system has a 
phase margin of 9m = 22.5°. Clearly, the gain and phase margins are measures of 
relative stability of the system. 

Figure 7.10c shows that the Nyquist plot of KG(s)H(s) crosses the real axis 
at -0.5 for K = 24. If we double K to a value 48, the magnitude of every point 
doubles (but the phase is unchanged). This step expands the Nyquist plot by a 
factor 2. Hence, for K = 48, the Nyquist plot lies on the real axis at -1; that 
is, KG{jui)H{ju >) = -1, and the system becomes unstable. For K > 48, the plot 
crosses and goes beyond the point -1. Thus, the critical point -1 lies inside the 
curve; that is, the curve encircles the critical point -1. When the Nyquist plot 
of an open-loop transfer function encircles the critical point -1, the corresponding 
closed-loop system becomes unstable. This statement, roughly speaking, is the well- 
known Nyquist criterion in a simplified form.f For the Nyquist plot in Fig. 7.10b 
(for K = 24), the gain will have to double before the system becomes unstable. 
Thus, the gain margin is 2 (6 dB)in this case. In general, if the Nyquist plot crosses 
the negative real axis at -a m , then the gain margin is l/a m . Similarly, if -ir +6 m 
is the angle at which the Nyquist plot crosses the unit circle, the phase margin is 
9 m . In the present case, 6 m = 22.5°. 

In order to protect a system from instability because of variations in system 
parameters (or in the environment), the system should be designed with reasonable 
gain and phase margins. Small margins indicate that the poles of the closed-loop 
system are in the LHP, but too close to the jui axis. The transient response of such 
systems will have a large overshoot (PO). On the other hand, very large (positive) 
gain and phase margins may indicate a sluggish system. Generally, a gain margin 
higher than 6 dB and a phase margin of about 30° to 60° are considered desirable. 
Design specifications for transient performance are often given in terms of gain and 
phase margins. 

T .3-2 Transient Performance in Terms of Frequency Response 

For a second-order system in Eq. (6.81), we saw the dependence of the transient 
response (PO, £ r , td and t s ) on the dominant pole location. Using this knowledge, 
we developed in Sec. 6.7 a procedure for designing a control system for a specified 
transient performance. In order to develop such a procedure from the knowledge 
of system’s frequency response (rather than its transfer function), we must know 
the relationship between the frequency response and the transient response of the 
system in Eq, (6.81). Figure 7.11 shows the frequency response of a second-order 
system in Eq. (6.81). The peak frequency response M p (the maximum value of 
the amplitude response), which occurs at frequency u p , indicates relative stability 
of the system. Higher peak response generally indicates smaller C (see Fig. 7.6a), 
which implies poles closer to the imaginary axis, and less relative stability. Higher 
M p also means higher PO (the step response overshoot). Generally acceptable 
values of M p in practice range from 1.1 to 1.5. The 3-dB bandwidth ui b of the 
frequency response indicates the speed of the system. We can show that ui b and t r 

fThe Nyquist criterion states as follows: A closed curve C s in the s plane enclosing m zeros and 
n poles of an open-loop transfer function W(s) maps into a closed curve C w in the W plane 
encircling the origin of the W plane m-n times, in the same direction as that of C s . If n - m is 
negative, then the encirclement is in the opposite direction. 
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Fig. 7.11 Frequency response of a second-order system. 


are inversely proportional. Hence, higher ait indicates smaller t r (faster response). 
For the second-oder system in Eq. (6.81), we have 

ui 2 

^ ) O'w) 2 + 2 + OJ 2 

To find M p , we let d\T(jui)\/du = 0. From the solution of this equation, we find 


2 ^ 1 -< 2 


C < 0.707 


<f < 0.707 



(7.27) 


These equations show that we can determine £ and u n from M p and u p . Knowledge 
of ( and u> n allow us to determine the transient parameters, such as, PO, t T and 
t s as seen from Eqs. (6.83), (6.84) and (6.85). Conversely, if we are given certain 
transient specifications PO, t r , and f s , we can determine the required M v and ui p . 
Thus, the problem now reduces to designing a system, which has a certain M v 
and u>p for the closed-loop frequency response. In practice, we know the open- 
loop system frequency response. So the ultimate problem reduces to relating the 
frequency response of the closed-loop system to that of the the open-loop system. 
To do this, we shall consider the case of unity feedback system, where the feedback 
transfer function is H(s) = l.f The closed-loop transfer function in this case is 


and 


Let 


T(s) 


KG(s) 

1 + KG(s) 


T (M = 


KGjju) 

1 + KG(jw) 


T(jcj) = and KG(ju) = x(oj) 4- jy{w) 


fThe results for the unity feedback can be extended to nonunity feedback systems. 



Fig. 7.12 Relationship between the open-loop and the closed-loop frequency response. 
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Consequently 

Me ja{u) = X + j V 

l + x + jy 

Straightforward manipulation of this equation yields 

M 2 \ 2 2 M 2 

X+ M 2 - lj +V ~ (M 2 - l) 2 

This is an equation of a circle centered at [— jjsli 0] and of radius in 

the KG(ju) plane. Figure 7.12a shows circles for various values of M. Because 
M is the closed-loop system amplitude response, these circles are the contours of 
constant amplitude response of the closed-loop system. For example, the point 
A = -2 - jl.85 lies on the circle M = 1.3. This means, at a frequency where the 
open-loop transfer function is G(jcj) = — 2 — jl.85, the corresponding closed-loop 
transfer function amplitude response is 1.3.f 

To obtain the closed-loop frequency response, we superimpose on these contours 
the Nyquist plot of the open-loop transfer function KG(jw). For each point of 
KG(jui), we can determine the corresponding value of M, the closed- loop amplitude 
response. From similar contours for constant a (the closed-loop phase response), 
we can determine the closed loop phase response. Thus, the complete closed-loop 
frequency response can be obtained from this plot. We are primarily interested 
in finding M p , the peak value of M and u> p , the frequency where it occurs. Figure 
7.12b indicates how these values may be determined. The circle to which the Nyquist 
plot is tangent corresponds to M p , and the frequency at which the Nyquist plot is 
tangential to this circle is u p . For the system, whose Nyquist plot appears in Fig. 
7.12b, Af p = 1.6 and oj p = 2. From these values, we can estimate ( and u>„, and 
determine the transient parameters PO, t r and t s . 

In designing systems, we first determine M p and u) p required to meet the given 
transient specifications from Eqs. (7.27). The Nyquist plot in conjunction with M 
circles suggests how these values of M p and u> p may be realized. In many cases, a 
mere change in gain K of the open-loop transfer function will suffice. Increasing K 
expands the Nyquist plot and changes the values M p and ui p correspondingly. If this 
is not enough, we should consider some form of compensation such as lag and/or 
lead networks. Using a computer, one can quickly observe the effect of particular 
form of compensation on M p and u p . 

7.4 Filter Design by Placement of Poles and Zeros OF H(s) 

In this section we explore the strong dependence of frequency response on the 
location of poles and zeros of H(s). This dependence points to a simple intuitive 
procedure to filter design. A systematic filter design procedure to meet given spec- 
ifications is discussed later in Secs. 7.5, 7.6, and 7.7. 

7.4-1 Dependence of Frequency Response on poles and Zeros of H(s) 

Frequency response of a system is basically the information about the filtering 
capability of the system. We now examine the close connection that exists between 


fWe can find similar contours for constant a (the closed-loop phase response). 


7.4 Filter Design by Placement of Poles and Zeros 


497 



Fig. 7.13 (a) vector representation of complex numbers (b) vector representation of factors 
of H(s). 


the pole-zero locations of a system transfer function and its frequency response (or 
filtering characteristics). A system transfer function can be expressed as 


Hl n P{f) , ~ Z\)(s - Z 2 ) ■ ■ ■ (s - Z n ) 

Q(s) "(« - Ai)(s - A 2 ) •••(«- A„) 


(7.28a) 


where z\, 22 , ■ • •, z n are the zeros of H (s) and the characteristic roots Ai, A 2 , . . 
A n are the poles of H{s). Now the value of the transfer function H($) at some 
frequency s = p is 


H(s) | s=p 


( P ~ *l)(p ~ *2) ’ (p ~ z n) 

( P - Ai )(p - A 2 ) •• • (p - An) 


(7.28b) 


This equation consists of factors of the form p - 2 , and p - A*. The factor p - 2 is a 
complex number represented by a vector drawn from point z to the point p in the 
complex plane, as illustrated in Fig. 7.13a. The length of this line segment is |p — 2 ), 
the magnitude of p - 2 . The angle of this directed line segment (with horizontal 
axis) is Z(p - 2 ). To compute H(s) at s = p, we draw line segments from all poles 
and zeros of H(s) to the point p, as shown in Fig. 7.13b. The vector connecting 
a zero Zi to the point p is p — z<. Let the length of this vector be fj, and let its 
angle with the horizontal axis be 4>i- Then p - zi — r,e^‘ . Similarly, the vector 
connecting a pole Aj to the point p is p — Aj = die- ,9i , where di and $i are the length 
and the angle (with the horizontal axis), respectively, of the vector p - Aj. Now 
from Eq. (7.28b) it follows that 


Therefore 


(rie- J ^ l )(r2e J * ! ) ■ ■ • (r n e-^") 
ls=p _ bn (d ie ^)(d 2 e^ 2 ) ■ ■ ■ (d n e^) 

_ b IlIilLlI" e J'Wi+^j+---+^n)-(«i+«a+-- '+0»)1 

"djd 2 ■ ■ ■ d n 


ji/(s)| s= p 


ri r 2 ■ ■ -r n 
did 2 ■ * * dn 


= b 


n 


product of the distances of zeros to p 
product of the distances of poles to p 


(7.29a) 
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and 

= (<t>l + <t>2 H + <t>n) - (01 + #2 H + 0 n ) 

= sum of zero angles to p - sum of pole angles to p (7.29b) 

Using this procedure, we can determine H(s) for any value of s. To compute the 
frequency response H (jai), we use s = jw (a point on the imaginary axis), connect 
all poles and zeros to the point ju, and determine |tf(ju)| and IH(juj) from Eqs. 
(7.29). We repeat this procedure for all values of u from 0 to oo to obtain the 
frequency response. 




Fig. 7.14 The role of poles and zeros in determining the frequency response of an LTIC 
system. 


Gain Enhancement by a Pole 

To understand the effect of poles and zeros on the frequency response, consider 
a hypothetical case of a single pole -a + ju> 0 , as depicted in Fig. 7.14a. To find 


the amplitude response \H (ju)\ for a certain value of u, we connect the pole to the 
point juj (Fig. 7.14a). If the length of this line is d. then J is proportional to 
1/d. 

I# 0)1 = — (7.30) 

where the exact value of constant K is not important at this point. As u increases 
from zero up, d decreases progressively until w reaches the value w 0 - As w in- 
creases beyond ui 0 , d increases progressively. Therefore, according to Eq. (7.30), 
the amplitude response \H (jw)| increases from w = 0 until u = w 0 , and it decreases 
continuously as u> increases beyond u 0 , as illustrated in Fig. 7.14b. Therefore, a 
pole at -a +ju 0 results in a frequency-selective behavior that enhances the gain at 
the frequency u>o (resonance). Moreover, as the pole moves closer to the imaginary 
axis (as a is reduced), this enhancement (resonance) becomes more pronounced. 
This is because o, the distance between the pole and jujQ (d corresponding to juj q), 
becomes smaller, which increases the gain K/d. In the extreme case, when a = 0 
(pole on the imaginary axis), the gain at wo goes to infinity. Repeated poles further 
enhance the frequency-selective effect. To summarize, we can enhance a gain at a 
frequency ljq by placing a pole opposite the point juj o- The closer the pole is to juj o, 
the higher is the gain at wo, and the gain variation is more rapid (more frequency- 
selective) in the vicinity of frequency w 0 . Note that a pole must be placed in the 
LHP for stability. 

Here we have considered the effect of a single complex pole on the system gain. 
For a real system, a complex pole -a+ju/o must accompany its conjugate -a- jug. 
We can readily show that the presence of the conjugate pole does not. appreciably 
change the frequency-selective behavior in the vicinity ofw 0 . This is because the 
gain in this case is K /dd , where d' is the distance of a point juj from the conjugate 
pole -a - ju 0 . Because the conjugate pole is far from ju 0 , there is no dramatic 
change in the length d as w varies in the vicinity of There is a gradual increase 
in the value of d' as w increases, which leaves the frequency-selective behavior as it 
was originally, with only minor changes. 

Gain Suppression by a Zero 

Using the same argument, we observe that zeros at -a ± ju 0 (Fig. 7.14d) will 
have exactly the opposite effect of suppressing the gain in the vicinity of wo, as shown 
in Fig. 7.14e). A zero on the imaginary axis at ju 0 will totally suppress the gain 
(zero gain) at frequency wo- Repeated zeros will further enhance the effect. Also, 
a closely-placed pair of a pole and a zero (dipole) tend to cancel out each other’s 
influence on the frequency response. Clearly, a proper placement of poles and zeros 
can yield a variety of frequency-selective behavior. Using these observations, we 
can design lowpass, highpass, bandpass, and bandstop (or notch) filters. 

Phase response can also be computed graphically. In Fig. 7.14a, angles formed 
by the complex conjugate poles -a ± ju 0 at w = 0 (the origin) are equal and 
opposite. As w increases from 0 up, the angle 6 1 because of the pole - a + ju 0 , 
which has a negative value at u = 0, is reduced in magnitude; the angle 0 2 because 
of the pole -a - ju 0l which has a positive value at u = 0, increases in magnitude. 
As a result, 9 1+62, the sum of the two angles, increases continuously, approaching a 
value 7r as u ► 00 . The resulting phase response LH{ju) = ~(6i +0 2 ) is illustrated 
in Fig. 7.14c. Similar arguments apply to zeros at —a ± juiQ. The resulting phase 
response LH ( ju> ) = (<t>i + <f> 2 ) is depicted in Fig. 7.14f. 
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We now focus on simple filters, using the intuitive insights gained in this dis- 
cussion. The discussion is essentially qualitative. 

7.4-2 Lowpass Filters 

A typical lowpass filter has a maximum gain at & = 0. Therefore, we need to 
place a pole (or poles) on the real axis opposite the origin (ju = 0), as shown in 
Fig. 7.15a. The transfer function of this system is 


We have chosen the numerator of H(s) to be w c in order to normalize the dc gain 
H(0) to unity. If d is the distance from the pole -u c to a point jui (Fig. 7.15a), 
then 

I^CMI = j 

with H( 0) = 1. As u> increases, d increases and \H (_?w) decreases monotonically 
with u>, as illustrated in Fig. 7.15d by label n = 1. This is clearly a lowpass filter 
with gain enhanced in the vicinity of ui = 0. 
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Wall-to-wall Poles 

gain 0 " unfit' nnTT Ch “ u ristic ( shaded ) in Fig. 7.15d, has a constant 
gam of umty up to frequency w c . Then the gain drops suddenly to 0 for w w 

To achieve the ideal lowpass characteristic, we need enhanced gain over the entire 
frequency band from 0 to w c . We know that to enhance a gain at any frequency t 

overThe band aC f e 0 a to P e i° PP0Site H W ' T °, achieve an enhanced 8*" for all frequencies 
hZi T u ( “ c) ’ We ne6d t0 Place a pole 0 PP 0S ite every frequency in this 

band. In other words, we need a continuous wall of poles facing theTmalart 
axis opposite the frequency band 0 to « c (and from 0 to - We for conjugate poles) 
as depicted m F,g. 7.15b. At this point, the optimum shape of this laU* not 
obvious because our arguments are qualitative and intuitive. Yet, it is certain that 
to have enhanced gain (constant gain) at every frequency over this range we need 
an infinite number of poles on this wall. We can show that for a maximally flat! 

numhp 86 f VCT | f qUe “ Cy range ( ° t0 the wal1 is a semicircle with an infinite 
number of poles uniformly distributed along the wall. 1 In practice, we compromise 

y using a finite number (n) of poles with less-than-ideal characteristics. Figure 
7T5c shows the pole configuration for a fifth-order („ = 5) filter. The amplitude 
response for various values of n are illustrated in Fig. 7.15d. As n - oo the filter 

fifierrTh P ere r 0 a a r I Th | S ^ ° f filterS is kn0Wn 85 the Butierworth 

hlters There are also other families. In Chebyshev filters, the wall shape is a 

semielhpse rather than a semicircle. The characteristics of a Chebyshev filter are 

inferior to those of Butterworth over the passband (0, w c ), where the characteristics 

theltonbandT TrTt ^ maximal, y flat res P°«^ of Butterworth. But 
the stopband (u» > u> e ), Chebyshev behavior is superior in the sense that Chebyshev 
filter gam drops faster than that of the Butterworth. 


t 



(a) (b) 

F,g. 7.16 Pole-zero configuration and the amplitude response of a bandpass filter. 

7.4-3 Bandpass Filters 

In thI h band aded fi C n ara< ;l eriStiC in Fig - 7 ' 16b Sh0WS the ideal band P^ filter gain. 
n the bandpass filter, the gam i s enhanced over the entire passband. Our earlier 

t Maximally flat amplitude response means the first 2n-l derivatives of \H(ju)l are zero at w = 0. 
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Fig. 7.17 Pole-zero configuration and the amplitude response of a bandstop (notch) filter. 


discussion indicates that this can be realized by a wall of poles opposite the imagi- 
nary axis in front of the passband centered at ujq. (There is also a wall of conjugate 
poles opposite -w 0 .) Ideally, an infinite number of poles is required. In prac- 
tice, we compromise by using a finite number of poles and accepting less-than-ideal 
characteristics (Fig. 7.16). 

7.4-4 Notch (Bandstop) Filters 

An ideal notch filter amplitude response (shown shaded in Fig. 7.17b) is a 
complement of the amplitude response of an ideal bandpass filter. Its gain is zero 
over a small band centered at some frequency wo and is unity over the remaining 
frequencies. Realization of such a characteristic requires an infinite number of poles 
and zeros. Let us consider a practical second-order notch filter to obtain zero gain at 
a frequency u = w 0 . For this purpose we must have zeros at ±jw 0 . The requirement 
of unity gain at u> = oo requires the number of poles to be equal to the number 
of zeros (m = n). This ensures that for very large values of w, the product of the 
distances of poles from w will be equal to the product of the distances of zeros from 
w. Moreover, unity gain at ui — 0 requires a pole and the corresponding zero to 
be equidistant from the origin. For example, if we use two (complex conjugate) 
zeros, we must have two poles; the distance from the origin of the poles and of 
the zeros should be the same . This requirement can be met by placing the two 
conjugate poles on the semicircle of radius w 0 , as depicted in Fig. 7.17a. The poles 
can be anywhere on the semicircle to satisfy the equidistance condition. Let the 
two conjugate poles be at angles ±9 with respect to the negative real axis. Recall 
that a pole and a zero in the vicinity tend to cancel out each other’s influences. 
Therefore, placing poles closer to zeros (selecting 6 closer to */2) results in a rapid 
recovery of the gain from value 0 to 1 as we move away from wo in either direction. 
Figure 7.17b shows the gain | H (jw)| for three different values of 9. 

I Example 7.5 

Design a second-order notch filter to suppress 60 Hz hum in a radio receiver. 
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We use the poles and zeros in Fig. 7.17a with w 0 = 120 t r. The zeros are at s = ±ju> 0 . 
The two poles are at -wocos 9±ju 0 sin 9. The filter transfer function is (with uio = 1207r) 


. (s - ju>o)(s +jui p) 

(s + u >0 cos e + juio sin 6)(s + w 0 cos 0 - ju 0 sin 9) 

s I 2 +vp = s 2 + 142122.3 

s 2 + (2 w 0 cos 0)s + uifi s 2 + (753.98 cos 0)s + 142122.3 


\H(ju>)\ = ■ 


-w 2 + 142122.3 

/(-u 2 + 1 42122. 3) 2 + (753. 98w cos 9) 2 


The closer the poles are to the zeros (closer the 6 to §), the faster the gain recovery from 
0 to 1 on either side of w„ = 120*. Figure 7.17b shows the amplitude response for three 
different values of 6. This example is a case of very simple design. To achieve zero gain 
over a band, we need an infinite number of poles as well as of zeros. ■ 


o Computer Example C7.3 

Plot the amplitude response of the transfer function 

H(s) ~ s ^ + u> ° 

S 2 + (2u>0 COS 9)S + UJq 

of a second order notch filter for w 0 = 120* and 9 = 60°, 80°, and 87°. 
w0=120*pi; 

theta=[60 80 87]*(pi/180); 
for m=l:length(theta) 
num=[l 0 wO * 2] ; 

den=[l 2*w0*cos(theta(m)) w0‘2]; 
w=0:. 5:1000; w=w’; 

[m a g, phase, w]=bode(num, den, w); 
plot(w, mag), hold on,axis([0 1000 0 1 . 1 ]) 
end Q 


Figures 7.16b and 7.17b show that a notch (stopband) filter frequency response 
is a complement of the bandpass filter frequency response. If H B p(s) and H B s{s) 
are the transfer functions of a bandpass and a bandstop filter (both centered at the 
same frequency), then 

Hbs(s) - 1 - H B p(s) 

Therefore, a bandstop filter transfer function may also be obtained from the corre- 
sponding bandpass filter transfer function. The case of lowpass and highpass filters 
is similar. If H LP (s) and H H p{s) are the transfer functions of a lowpass and a 
highpass filter respectively (both with the same cutoff frequency), then 


Hhp(s) = 1 - H lp (s) 


Therefore, a highpass filter transfer function may also be obtained from the corre- 
sponding lowpass filter transfer function. 
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A Exercise E7.2 

Using the qualitative method of sketching the frequency response, show that the system with 
the pole-zero configuration in Fig. 7.18a is a highpass filter, and that with the configuration in 
Fig. 7.18b is a bandpass filter. v 


t 

Im 


s plane 


t 

Im 


x U'0) 0 


Re- 


-9- 


Re — > 


x 


(a) (b) 

Fig. 7.18 Pole- zero configuration of a highpass filter in Exercise E7.2. 


7.4-5 Practical Filters and Their Specifications 

For ideal filters everything is black and white; the gains are either zero or unity 
over certain bands. As we saw earlier, real life does not permit such a world view. 
Things have to be gray or shades of gray. In practice, we can realize a variety of 
filter characteristics which can only approach ideal characteristics. 

An ideal filter has a passband (unity gain) and a stopband (zero gain) with 
a sudden transition from the passband to the stopband. There is no transition 
band. For practical (or realizable) filters, on the other hand, the transition from 
the passband to the stopband (or vice versa) is gradual, and takes place over a finite 
band of frequencies. Moreover, for realizable filters, the gain cannot be zero over 
a finite band (Paley-Wiener condition). As a result, there can no true stopband 
for practical filters. We therefore define a stopband to be a band over which the 
gain is below some small number G 3 , as illustrated in Fig. 7.19. Similarly, we define 
a passband to be a band over which the gain is between 1 and some number 
G p ( G p < 1), as shown in Fig. 7.19. We have selected the passband gain of unity 
for convenience. It could be any constant. Usually the gains are specified in terms 
of decibels. This is simply 20 times the log (to base 10) of the gain. Thus 

G(dB) = 201og 10 G 

A gain of unity is 0 dB and a gain of \fl is 3.01 dB, usually approximated by 3 dB. 
Sometimes the specification may be in terms of attenuation, which is the negative of 
the gain in dB. Thus a gain of 1 /V2\ that is, 0.707, is -3 dB, but is an attenuation 
of 3 dB. 

In our design procedure we assume that G p (minimum passband gain) and 
G s (maximum stopband gain) are specified. Figure 7.19 shows the passband, 
the stopband, and the transition band for typical lowpass, bandpass, highpass, and 


I //Urn) I 


IffO'oi)! 








Fig. 7.19 Passband, stopband, and transitionband in various types of filters. 


bandstop filters. In this chapter we shall discuss the design procedures for these 
four types of filters. Fortunately, the highpass, bandpass, and bandstop filters can 
be obtained from a basic lowpass filter by simple frequency transformations. For 
example, replacing s with u > c /s in the lowpass filter transfer function results in a 
highpass filter. Similarly, other frequency transformations yield the bandpass and 
bandstop filters. Hence, it is necessary to develop a design procedure only for a basic 
lowpass filter. Using appropriate transformations, we can then design other types 
of filters. We shall consider here two well known families of filters: the Butterworth 
and the Chebyshev filters. 


7.5 Butterworth Filters 

The amplitude response \H(ju ) | of an nth order Butterworth lowpass filter is 
given by 





(7.31) 


Observe that at w = 0, the gain |i7(j'0)| is unity and at u = ui c , the gain \H(ju c )\ = 
1/V2 or -3 dB. The gain drops by a factor V2 at uj = u c . Because the power 
is proportional to the amplitude squared, the power ratio (output power to input 
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Fig. 7.20 Amplitude response of a normalized lowpass Butterworth filter. 

power) drops by a factor 2 at u = ui c . For this reason w c is called the half-power 
frequency or the 3 dB-cutoff frequency (amplitude ratio of v^2 is 3 dB). 

Normalized Filter 

In the design procedure it proves most convenient to consider a normalized 
filter H(s), whose half-power frequency is 1 rad/s (u c = 1). For such a filter, the 
amplitude characteristic in Eq. (7.31) reduces to 


|W(iw)| 



(7.32) 


We can prepare a table of normalized transfer functions H(s) which yield the fre- 
quency response in Eq. (7.32) for various values of n. Once the normalized transfer 
function is obtained, we can obtain the desired transfer function H(s) for any value 
of uj c by simple frequency scaling, where we replace s by s/u c in the normalized 
W(s). 


The amplitude response |W(ju»)| of the normalized lowpass Butterworth filters 
is depicted in Fig. 7.20 for various values of n. From Fig. 7.20 we observe the 
following: 


1. The Butterworth amplitude response decreases monotonically. Moreover, the 
first 2n — 1 derivatives of the amplitude response are zero at u = 0. For 
this reason this characteristic is called maximally flat at w = 0. Observe 
that a constant characteristic (ideal) is maximally flat for all w < 1. In the 
Butterworth filter we try to retain this property at least at the origin.) 


2. The filter gain is 1 (0 dB) at u = 0 and 0.707 (-3 dB) at u - 1 for all n 
Therefore, the 3-dB (or half power) bandwidth is 1 rad/s for all n. 


3. For large n, the amplitude response approaches the ideal characteristic. 


To determine the corresponding transfer function H(s), recall that is 

the complex conjugate of H{jw). Therefore 


«(M*(-i«) = \n(ju,)\ 2 = — 

1 + U) ln 


f Butterworth filter exhibits maximally flat characteristic also at u — oo. 
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n odd n even 



Fig. 7.21 Poles of a normalized even-order lowpass Butterworth Filter transfer function 
and its conjugate. 


Substituting s = ju> in this equation, we obtain 


www <-)-rn^ 

The poles of H(s)W(-s) are given by 

s 2n = _ (j) 2n 


In this result we use the fact that — 1 = e^ 2 ^ 1) for integral values of k , and 
j = to obtain 


s 2n = e M2k-l+n) jnteger 

This equation yields the poles of H(s)X(-s) as 

Sfc = e£ (2 * +n - 1) k = 1, 2, 3, ..., 2n (7.33) 

Observe that all poles have a unit magnitude; that is, they are located on a unit 
circle in the s-plane separated by angle n/n, as illustrated in Fig. 7.21 for odd 
and even n. Since H(s) is stable and causal, its poles must lie in the LHP. The 
poles of W(-s) are the mirror images of the poles of H{s) about the vertical axis. 
Hence, the poles of 7i{s) are those in the LHP and the poles of H(-s) are those 
in the RHP in Fig. 7.21. The poles corresponding to H(s) are obtained by setting 
k = 1, 2, 3, . . . , n in Eq. (7.33); that is 
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n = 1 n= 2 n = 3 n = 4 



(») (b) (c) (d) 

Fig. 7.22 Poles of a normalized lowpass Butterworth filter of various orders. 


For instance, from Eq. (7.34), we find the poles of 'H(s) for n = 4 to be at angles 
5 tt/8, 7tt/8, 9tt/ 8, and llrr/8. These lie on the unit circle, as shown in Fig. 7.22, and 
are given by -0.3827 ± jO.9239, -0.9239 ± j0.3827. Hence, H(s) can be expressed 
as 


H(s) = _ i 

(a + 0.3827 - j0.9239)(s + 0.3827 + j0.9239)(s + 0.9239 - ;0.3827)(s + 0.9239 + j0.3827) 

1 

(s 2 + 0.7654s + l)(s 2 + 1.8478s + 1) 

_ 1 

s 4 + 2.6131s 3 + 3.4142s 2 + 2.6131s + 1 


We can proceed in this way to find H(s) for any value of n. In general 


7f(s) = 


s n + a n _is n 1 + ■ ■ • + a is + 1 


where B n (s) is the Butterworth polynomial of the nth order. Table 7.1 shows the 
coefficients oi, a 2 , ■ . ., a n _ 2 , a n _! for various values of n; Table 7.2 shows B n (s) in 
factored form. In these Tables, we read for n = 4 


~ s 4 + 2.6131s 3 + 3.4142s 2 + 2.6131s + 1 

1 

~ (s 2 + 0.7654s + l)(s 2 + 1.8478s + 1) 

a result, which confirms our earlier computations. 

We can also find the normalized Butterworth filter transfer function using 
MATLAB function [z,p,k]=buttap(n) to find poles, zeros and the gain factor of a 
normalized nth-order Butterworth filter. 

O Computer Example C7.4 

Using MATLAB, find poles, zeros, and the gain factor of a normalized 4th-order 
Butterworth filter. 

[z,p,k]=buttap(4) 

MATLAB returns poles, zeros, and the gain factor k, which is unity for all orders. Q 
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Frequency Scaling 

Although Tables 7.1 and 7.2 are for normalized Butterworth filters with 3 dB 
bandwidth u c = 1, the results can be extended to any value of u c by simply replacing 
s by s/u c . This step implies replacing u by u/u c in Eq. (7.32). For example, the 
second-order Butterworth filter for u c = 100 can be obtained from Table 7.1 by 
replacing s by s/100. This step yields 


(loo) + ^ (100) + 1 


s 2 + 100\/2s + 10 4 1 ' ’ 

The amplitude response \H(ju)\ of the filter in Eq. (7.37) is identical to that 
of normalized \7i(ju)\ in Eq. (7.32), expanded by a factor 100 along the horizontal 
(u) axis (frequency scaling). 

Determination of n, the Filter Order 

If G x is the gain of a lowpass Butterworth filter in dB units at u = u, , then 
according to Eq. (7.31) 


G x - 201og 10 | H(ju x 


-10 log 1+ -£ 

\U C 


Substitution of the specifications in Fig. 7.19a (gains G p at u p and G s at u a ) in this 
equation yields 


G p = -10 log 1 + 


-10 log 1 + — 

\ui c 


= lO -6 ”/ 10 - 1 


= 10 - ®’/ 10 - 1 


Dividing (7.38b) by (7.38a), we obtain 


lO-G./io _ ! 

10 -G p /1° _ 1 


(7.38a) 


(7.38b) 


log[(lO- < 5 -/ 10 -l)/(lO- < 5 »/io_ l y 

21og(w s /u p ) 
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Also from Eq. (7.38a) 

u c 

Alternatively, from Eq. (7.38b) 
u c 



(7.40) . 

(7.41) 


I Example 7.6 

Design a Butterworth lowpass filter to meet the specifications (Fig. 7.23): 

(i) Passband gain to lie between 1 and G p = 0.794 (G p = -2dB)for0 < u; < 10. 

(ii) Stopband gain not to exceed G, = 0.1 (G s = -20 dB) forw > 20. 

Step 1: Determine n 

Here ui p = 10, = 20, G p = —2 dB, and G s = —20 dB. Substituting these values in 

Eq. (7.39) yields 

n = 3.701 

Since n can only be an integer, we choose 

n = 4 

Step 2: Determine ui c 

Substitution of n = 4, u p — 10 in Eq. (7.40) yields 


u c = 10.693 

Alternately, substitution of n = 4 in Eq. (7.41) yields 


u c = 11.261 

Because we selected n = 4 rather than 3.701, we obtain two different values of w c . 
Choice of u c = 10.693 will satisfy exactly the requirement G p = 0.794 over the 
passband (0, 10), and will surpass the requirement G, = 0.1 in the stopband u > 20. 
On the other hand, choice of u c — 11.261 will exactly satisfy the requirement on G s 
but will oversatisfy the requirement for G p . Let us choose the former case [u c = 
10.693). 

Step 3: Determine the normalized transfer function "H(s ) 

The normalized fourth-order transfer function H(s) is found from Table 7.1 as 

■yj f \ 1 

y 1 ~ s 4 + 2.6131s 3 + 3.4142s 2 + 2.6131s + 1 
Step 4: Determine the final filter transfer function H(s ) 

The desired transfer function with u c = 10.693 is obtained by replacing s with 
s/10.693 in the normalized transfer function H(s) as 



13073.7 

s 4 + 27.942s 3 + 390.4s 2 + 3194.88s + 13073.7 

13073.7 

(s 2 + 8.1844s + 114.34)(s 2 + 19.758s + 114.34) 
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0) c = 10.693 

Fig. 7.23 Amplitude response of the lowpass Butterworth filter in Example 7.6. 
The amplitude response of this filter is given by Eq. (7.31) with n = 4 and ui c = 10.693 
\H(Ju)\ = 

Figure 7.23 shows the amplitude response of this filter. 

We could also have used the alternate value of w c = 11.261. This choice would result 
in a slightly different design. Either of the two designs satisfies the specifications. I 




Q Computer Example C7.5 

Solve Example 7.6 using MATLAB 

% Step 1: Determine n 
wp=10; ws=20; Gp=-2; Gs=-20; 

Pl=-Gs/10; P2=-Gp/10; Wsp=ws/wp; 

nc=log((10‘Pl-l)/(10‘P2-l))/(2*log(Wsp)); 

n=ceil(nc); 

% Step 2: Determine Wc (option that satisfies passband requirement 
% exactly and may oversatisfy stopband requirement). 
Wc=wp/(10‘P2-l)‘(l/(2*n)); 

% Step 3: Determine the normalized transfer function H(s) 
for k=l:n 

A=(2*(k-l)+n+l)/(2*n); 

Sk=cos(A*pi)+j*sin(A*pi); 
s=[s Sk); 
end 
s=s’; 

numl=[0 1]; denl=poly([s’]); 

% Step 4: Determine the final filter transfer function H(s) 
num2=[0 Wc'n]; den2=poly(Wc*[s’]); 
fprintf(’Filter Order is n = %i\n’,n) 

fprintf(’Cutoff Frequency of the Filter is Wc = %.4f\n’,Wc) 
disp(’Poles of the transfer function are’),s 
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disp(’The normalized fourth-order transfer function is’) 
printsys(abs(numl),abs(denl)) 

disp(’The transfer function with s replaced by s/Wc is’) 
printsys(abs(num2),abs(den2)) 

% Step 5: Amplitude response of the filter 
w=0;. 01:40; w=w’; 

[mag, phase, w]=bode(num2,den2,w); 
plot(w,mag) 

Filter Order is a * 4 

Cutoff Frequency of the Filter is Wc - 10.6934 

Poles of the transfer function are 

s = -0.3827 - 0.9239i 

-0.9239 - 0.3827i 

-0.9239 + 0.3827i 

-0.3827 + 0.9239i 

The normalized fourth-order transfer function is 


num/den = 


1 

s‘4 + 2.613 s‘3 + 3.414 s"2 + 2.613 s + 1 


The transfer function with s replaced by s/Wc is 


num/den = 


13, 000 

s‘4 + 27.94 s‘3 + 390.4 s‘2 + 3195 s + 1.3 e+004 


o 


Using M-files from MATLAB Signal Processing Toolbox 

We can also compute the desired filter transfer function using appropriate Af- 
files from the Signal Processing Toolbox as shown in the next few examples. 

Q Computer Example C7.6 

Using Af-file functions in MATLAB, design a lowpass Butterworth filter to meet the 
specifications in Example 7.6. 

Wp=10;Ws=20;Gp=-2;Gs=-20; 

[n,Wc]=buttord(Wp,Ws,-Gp,-Gs, V); 

[num,den]=butter(n,Wc,V); 

Here num and den are the coefficients of the numerator and the denominator poly- 
nomials of the desired filter. In this example, the matlab answer is n + 1 element vectors 
as num= 0 0 0 0 16081 and den= 1 29 433 3732 16081; that is, 

H(s) = 16081 

K ' s 4 + 29 s 3 + 433s 2 + 3732s + 16081 

This is the alternate solution where the passband specifications are exceeded, but the 
stopband specifications are satisfied exactly. On the other hand, the solution in Example 
C7.5 exceeds the stopband specifications, but satisfies the passband specifications exactly 
because of use of Eq. (7.40) [rather than Eq. (7.41)]. To plot amplitude response, we can 
use the last three functions from Example C7.5. 0 

A Exercise E7.3 

Determine n, the order of the lowpass Butterworth filter to meet the following specifications: 
G p = -0.5 dB, G a = -20 dB, w p - 100, andw* = 200. 

Answer: 5. V 
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7.6 Chebyshev Filters 


The amplitude response of a normalized Chebyshev lowpass filter is given by 


\H{ju)\ = - 

\jl + e 2 C n 2 (o;) 

where C n (ui), the nth-order Chebyshev polynomial, is given by 

C n (u ) = cos (n cos -1 to) 

An alternative expression for C„(ui) is 


(7.43a) 


C n (u) = cosh (n cosh 1 u) (7.43b) 

The form (7.43a) is most convenient to compute C n (u>) for |w| < 1 and form 
(7.43b) is convenient for computing C n { u>) for \u\ > 1. We can show 1 that C n (u>) 
is also expressible in polynomial form, as shown) in Table 7.3 for n = 1 to 10. 

The normalized Chebyshev lowpass amplitude response [Eq. (7.42)] is depicted 
in Fig. 7.24 for n = 6 and n = 7. We make the following general observations: 


Table 7.3: Chebyshev Polynomials 


n C n (u) 


0 1 

1 U) 

2 2a; 2 — 1 

3 4a; 3 - 3w 

4 8a; 4 — 8a; 2 + 1 

5 16o> 5 - 20a; 3 + 5w 

6 32a; 6 - 48 w 4 + 18o> 2 - 1 

7 64a; 7 - 112a; 5 + 56a; 3 - 7w 

8 1 28a; 8 - 256a; 6 + 160a; 4 - 32a; 2 + 1 

9 256a; 9 — 576u; 7 -I- 432a; 5 — 120a; 3 + 9a; 

10 512w 10 - 1280a; 8 + 1120a; 6 - 400a; 4 + 50a) 2 - 1 


(The Chebyshev polynomial C„( w) has the property 1 

C„(ui) = 2o;C n _i(o)) — C n _ 2 ( 0 ;) n > 2 

Thus, knowing that 

CoM = 1 and C\{u) = u 
we can construct C n (o;) for any value of n. For example, 


and so on. 


C2{oj) = 2ujC\ (cj) — Co(cj) = 2u> 2 — 1 
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t t 



Fig. 7.24 Amplitude response of normalized sixth- and seventh-order lowpass Chebyshev 
filters. 


1. The Chebyshev amplitude response has ripples in the passband and is smooth 
(monotonic) in the stopband. The passband is 0 < u> < 1, and there is a total 
of n maxima and minima over the passband 0 < u > < 1. 

2. From Table 7.3, we observe that 


Cl( 0) = 


Therefore, the dc gain is 

{ 1 n odd 

1 (7.45) 

n even 

3. The parameter e controls the height of ripples. In the passband, r, the ratio of 
the maximum gain to the minimum gain is 


= Vl + e 2 


(7.46a) 


This ratio r, specified in decibels, is 

f = 20 log y/l + e 2 = 101og 10 (l + e 2 ) (7.46b) 

so that 

e 2 = 10^ 10 - 1 (7 .4 7) 

Because all the ripples in the passband are of equal height, the Chebyshev 
polynomials C n (u;) are known as equal-ripple functions. 

4. The ripple is presen t only over the passband 0 < u < 1. At w = 1, the ampli- 
tude response is 1/ Vl + e 2 = 1/r. For w > 1, the gain decreases monotonically. 

5. For Chebyshev filters, the ripple f dB takes the place of G p (the minimum gain 
in the passband). For example, r < 2 dB specifies that the gain variations of 
more than 2 dB cannot be tolerated in the passband. In the Butterworth filter 

= -2 dB means the same thing. 

6. If we reduce the ripple, the passband behavior improves, but it does so at 
the cost of stopband behavior. As r is decreased (e is reduced), the gain in 
the stopband increases, and vice-versa. Hence, there is a tradeoff between the 
allowable passband ripple and the desired attenuation in the stopband. Note 
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that the extreme case e = 0 yields zero ripple, but the filter now becomes an 
allpass filter, as seen from Eq. 7.42, by letting e = 0. 

7. Finally, the Chebyshev filter has a sharper cutoff (smaller transition band) 
than the same-order Butterworth filter,) but this is achieved at the expense of 
inferior passband behavior (rippling). 

Determination of n (Filter Order) 

For a normalized Chebyshev filter, the gain G in dB [see Eq. (7.42)] is 

G = — 101og[l + e 2 C n 2 (uO] 

The gain is G s at lo s . Therefore 


G a = -10 log [1 + e 2 C n 2 ( Wi ,)] 
or 

e 2 C n 2 (w s ) = 10- 6 */ 10 - 1 

Use of Eq. (7.43b) and Eq.(7.47) in the above equation yields 


cosh [ncosh 1 (a) s )] = 


10 -<5,/io _ i 
10 f / 10 - 1 


1 10~ d ‘/ 10 -l! 

n = r cosh — 

cosh -1 (w s ) 10 r / l ° - 1 


(7.49a) 


Note that these equations are for normalized filters, where u p = 1. For a general 
case, we replace ui a with ^ to obtain 


cosh '(wj/up) 


x r io - 6 */ 10 - 1 
10 f /io - 1 


(7.49b) 


Pole Locations 

We could follow the procedure of the Butterworth filter to obtain the pole 
locations of the Chebyshev filter. The procedure is straightforward but tedious and 
does not yield any special insight into our development. The Butterworth filter 
poles lie on a semicircle. We can show that the poles of an nth-order normalized 
Chebyshev filter lie on a semiellipse of the major and minor semiaxes cosh x and 
sinh x, respectively, where 1 


x = — sinh 
n 


The Chebyshev filter poles are 


Sk = - sin 


(2k — 1W1 

smh x + j cos 


(2k - 1)tt 
2 n 


cosh x k = 1,2, ■ ■ ■ ,n (7.51) 


| We can show 2 that at higher frequencies (in the stopband), the Chebyshev filter gain is smaller 
than the comparable Butterworth filter gain by about 6(n — 1) dB. 
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Fig. 7.25 Poles of a normalized third-order lowpass Chebyshev filter transfer function 
and its conjugate. 


The geometrical construction for determining the pole location is depicted in Fig. 
7.25 for n — 3. A similar procedure applies to any n\ it consists of drawing two 
semicircles of radii a = sinh x and 6 = cosh x. We now draw radial lines along 
the corresponding Butterworth angles and locate the nth-order Butterworth poles 
(shown by crosses) on the two circles. The location of the fcth Chebyshev pole is 
the intersection of the horizontal projection and the vertical projection from the 
corresponding fcth Butterworth poles on the outer and the inner circle, respectively. 

The transfer function 'H(s) of the normalized nth-order lowpass Chebyshev 
filter is 


«(*) = 


s n + a n _i s n 1 H + ajs + < 


The constant K n is selected to have proper dc gain, as shown in Eq. (7.45). As a 
result 



Oo 

10 f /20 


n odd 
n even 


(7.53) 


The design procedure is considerably simplified by ready-made tables of the 
polynomial C(,(s) in Eq. (7.52) or the pole locations of H(s). Table 7.4 lists the co- 
efficients a 0 , a i, a 2 , ■ • • , a„_i of the polynomial C' n (s) in Eq. (7.52) for f = 0.5, 1, 2, 
and 3 dB ripples corresponding to the values of e = 0.3493, 0.5088, 0.7648, and 
0,9976, respectively. Table 7.5 lists the poles of various Chebyshev filters for the 
same values of f (and e). Tables listing more extensive values of f (or e) can be 
found in the literature. We can also use MATLAB functions for this purpose. 

0 Computer Example C7.7 

Using MATLAB, find poles, zeros, and the gain factor of a normalized 3rd-order 
Chebyshev filter with f = 2 dB. 


[z,p,k]=cheblap(3,2) Q 
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Table 7.4: Chebyshev Filter Coefficients of the Denominator Polynomial 

^n( s ) = 5 n + 1 -f- a n _ 2S n 2 + * - • + ais + ao 


n ao ai 


a 2 a 3 a 4 


as a& 


1 2.8627752 

2 1.5162026 1.4256245 

3 0.7156938 1.5348954 

4 0.3790506 1.0254553 

5 0.1789234 0.7525181 

6 0.0947626 0.4323669 

7 0.0447309 0.2820722 


1.2529130 

1.7168662 

1.3095747 

1.1718613 

0.7556511 


1.1973856 

1.9373675 

1.5897635 

1.6479029 


1.1724909 

2.1718446 

1.8694079 


0.5 db ripple 
(f = 0.5) 


1.1591761 

2.4126510 1.1512176 


1 

1.9652267 





1 db ripple 

2 

1.1025103 

1.0977343 




(f = 1) 

3 

0.4913067 

1.2384092 

0.9883412 




4 

0.2756276 

0.7426194 

1.4539248 

0.9528114 



5 

0.1228267 

0.5805342 

0.9743961 

1.6888160 

0.9368201 


6 

0.0689069 

0.3070808 

0.9393461 

1.2021409 

1.9308256 

0.9282510 

7 

0.0307066 

0.2136712 

0.5486192 

1.3575440 

1.4287930 

2.1760778 0.9231228 


1 1.3075603 

2 0.8230604 0.8038164 

3 0.3268901 1.0221903 

4 0.2057651 0.5167981 

5 0.0817225 0.4593491 

6 0.0514413 0.2102706 

7 0.0204228 0.1660920 


0.7378216 

1.2564819 0.7162150 
0.6934770 1.4995433 
0.7714618 0.8670149 
0.3825056 1.1444390 


0.7064606 

1.7458587 

1.0392203 


2 db ripple 

(f = 2) 


0.7012257 

1.9935272 0.6978929 


1 1.0023773 

2 0.7079478 0.6448996 

3 0.2505943 0.9283480 

4 0.1769869 0.4047679 

5 0.0626391 0.4079421 

6 0.0442467 0.1634299 

7 0.0156621 0.1461530 


0.5972404 

1.1691176 

0.5488626 

6990977 

0.3000167 


0.5815799 

1.4149874 0.5744296 
6906098 1.6628481 

1.0518448 0.8314411 


3 db ripple 
(f = 3) 


0.5706979 

1.9115507 0.5684201 
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Table 7.5: Chebyshev Filter Pole Locations 


n r = 0.5 

f = 1 

f = 2 

DM 

1 -2.8628 

-1.9652 

-1.3076 

-1.0024 

2 -0.7128 ±j 1.0040 

-0.5489 ± >0.8951 

-0.4019 ±>0.8133 

-0.3224 ± >0.7772 

3 -0.6265 

—0.3132 ± >1.0219 

-0.4942 

-0.2471 ± >0.9660 

-0.3689 

-0.1845 ±>0.9231 

-0.2986 

-0.1493 ± >0.9038 

4 —0.1754 ±>1.0163 
-0.4233 ± >0.4209 

-0.1395 ±>0.9834 
-0.3369 ± >0.4073 

-0.1049 ±>0.9580 
-0.2532 ± >0.3968 

-0.0852 ± >0.9465 
-0.2056 ± >0.3920 

5 -0.3623 

—0.1120 ±>1.0116 
-0.2931 ± >0.6252 

-0.2895 

-0.0895 ± >0.9901 
-0.2342 ±>0.6119 

-0.2183 

-0.0675 ±>0.9735 
-0.1766 ±>0.6016 

-0.1775 

-0.0549 ± >0.9659 
-0.1436 ±>0.5970 

6 -0.0777 ± >1.0085 
-0.2121 ± >0.7382 
-0.2898 ±> 0.2702 

-0.0622 ±>0.9934 
-0.1699 ±>0.7272 
-0.2321 ±>0.2662 

-0.0470 ±>0.9817 
-0.1283 ±>0.7187 
-0.1753 ± >0.2630 

-0.0382 ± >0.9764 
-0.1044 ±>0.7148 
-0.1427 ±>0.2616 

7 -0.2562 

-0.0570 ±>1.0064 
-0.1597 ±>0.8071 
-0.2308 ±>0.4479 

-0.2054 

-0.0457 ± >0.9953 
-0.1281 ± >0.7982 
-0.1851 ±>0.4429 

-0.1553 

-0.0346 ±>0.9866 
-0.0969 ±>0.7912 
-0.1400 ±>0.4391 

-0.1265 

-0.0281 ± >0.9827 
-0.0789 ± >0.7881 
-0.1140 ±>0.4373 

8 -0.0436 ±>1.0050 
-0.1242 ±>0.8520 
-0.1859 ±>0.5693 
-0.2193 ±>0.1999 

-0.0350 ± >0.9965 
-0.0997 ± >0.8447 
-0.1492 ±>0.5644 
-0.1760 ±>0.1982 

-0.0265 ±>0.9898 
-0.0754 ± >0.8391 
-0.1129 ±>0.5607 
-0.1332 ±>0.1969 

-0.0216 ± >0.9868 
-0.0614 ±>0.8365 
-0.0920 ± >0.5590 
-0.1085 ±>0.1962 

9 -0.1984 

-0.0345 ±>1.0040 
-0.0992 ±>0.8829 
-0.1520 ±>0.6553 
-0.1864 ±>0.3487 

-0.1593 

-0.0277 ±>0.9972 
-0.0797 ±>0.8769 
-0.1221 ±>0.6509 
-0.1497 ±>0.3463 

-0.1206 

-0.0209 ± >0.9919 
-0.0603 ± >0.8723 
-0.0924 ± >0.6474 
-0.1134 ±>0.3445 

-0.0983 

-0.0171 ± >0.9896 
-0.0491 ± >0.8702 
-0.0753 ± >0.6459 
-0.0923 ±>0.3437 

10 -0.0279 ±>1.0033 
-0.0810 ±>0.9051 
-0.1261 ± >0.7183 
-0.1589 ±>0.4612 
-0.1761 ± >0.1589 

-0.0224 ±>0.9978 
-0.1013 ±>0.7143 
-0.0650 ± >0.9001 
-0.1277 ±>0.4586 
-0.1415 ±>0.1580 

-0.0170 ± >0.9935 
-0.0767 ±>0.7113 
-0.0493 ± >0.8962 
-0.0967 ± >0.4567 
-0.1072 ±>0.1574 

-0.0138 ±>0.9915 
-0.0401 ± >0.8945 
-0.0625 ± >0.7099 
-0.0788 ± >0.4558 
-0.0873 ±>0.1570 
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Fig. 7.26 Amplitude response of the lowpass Chebyshev filter in Example 7.7. 

H Example 7.7 

Design a Chebyshev lowpass filter to satisfy the following criteria (Fig. 7.26): 

_ The ratio f < 2 dB over a passband 0 < ui < 10 (qj p = 10). The stopband gain 
G, < -20 dB for uj > 16.5 (w, = 16.5). 

Observe that the specifications are the same as those in Example 7.6, except for the 
transition band. Here the transition band is from 10 to 16.5, whereas in Example 7.6 it 
is 10 to 20. Despite this stringent requirement, we shall find that Chebyshev requires a 
lower-order filter than the Butterworth filter found in Example 7.6. 

Step 1: Determining n 

According to Eq. (7.49b), we have 


1 , _i T 10 2 — 1 ] 1/2 

" = r osh-(1.65) COSh [io^t] = 2 ' 999 

Because n must be an integer, we select n = 3. Observe that even with more stringent 
requirements, the Chebyshev filter requires only n = 3. The passband behavior of 
the Butterworth filter, however, is superior (maximally flat at w = 0) compared to 
that of the Chebyshev, which has rippled passband characteristics. 

Step 2: Determining H{s) 

We may use the Table 7.4 to determine H{s). For n = 3 and f = 2 dB, we read 
the coefficients of the denominator polynomial of 'H(s) as a 0 = 0.3269, ai = 1.0222, 
and a 2 = 0.7378. Also in Eq. (7.53), for odd n, the numerator is given by a constant 
K n = ao = 0.3269. Therefore, 

n( . _ 0.3269 

3 s 3 + 0.7378s 2 + 1.0222s + 0.3269 l7 ' 54 ^ 

Because there are infinite possible combinations of n and r, Table 7.4 (or 7.5) can list 
values of the denominator coefficients for values of f in quantum increments only. 1 
For the values of n and r not listed in the Table, we can compute pole locations 
from Eq. (7.51). For the sake of demonstration, we now recompute H(s) using this 
method. In this case, the value of e is [see Eq. (7.47)] 
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From Eq. (7.50) 

x = i sinh -1 i = i sinh _1 (1.3077) = 0.3610 

Now from Eq. (7.51), we have si = -0.1844 + j'0.9231, s 2 = -0.3689, and s 3 = 
— 0.1844 — jO. 9231. Therefore 

Kn 

(s + 0.3689) (s + 0.1844 + ;0.9231)(s + 0.1844 - jO.9231) 

An _ 0.3269 

a 3 + 0.7378s 2 + 1.0222s + 0.3269 s 3 + 0.7378s 2 + 1.0222s + 0.3269 

which confirms the earlier result. 

Step 3: Determining H(s) 

Recall that w p = 1 for the normalized transfer function. For u r = 10, the desired 
transfer function H(s ) can be obtained from the normalized transfer function 7i(s) 
by replacing s with s/u p = s/10. Therefore 

H(s) = — _ 3269 

(ifi + 0-3689)( B + 0.1844 + j0.9231)( ^ + 0.1844 - /0.9231) 

326.9 

s 3 + 7.378s 2 + 102.22s + 326.9 

In the present case, f = 2 dB means that [see Eq. (7.47)] 

e 2 = io °- 2 _ 1 = 0.5849 

The frequency response is [see Eq. (7.42) and Table 7.3] 
l«(jw)| = 

This is the normalized filter amplitude response. The actual filter response \H(jui)\ 
is obtained by replacing u with that is, with fg in H{ju) 




Observe that despite more stringent specifications than those in Example 7.6, the 
Chebyshev filter requires n = 3 compared to the Butterworth filter in Example 7.6, which 
requires n — 4. Figure 7.26 shows the amplitude response. I 

O Computer Example C7.8 

Design a lowpass Chebyshev filter for the specifications in Example 7.7 using functions 
from Signal Processing Toolbox in MATLAB. 

Wp=10;Ws=16.5;r=2;Gs=-20; 

[n,Wp]=cheblord(Wp,Ws,r,-Gs,’s’); 

[num,den]=chebyl(n,r,Wp,’s’); 
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MATLAB returns n = 3 and num= 0 0 0 326.8901, den= 1 7.3782 102.219 
326.8901; that is, 

. 326.8901 

3 s 3 + 7.3782s 2 + 102.219s + 326.8901 

a result, which agrees with the solution in Example 7.7. To plot amplitude response, we 
can use the last three functions from Example C7.5. © 

A Exercise E7.4 

Determine n, the order of the lowpass Butterworth filter to meet the following specifications: 
G P — — 0.5dB, G s = — 20 dB, u> p = 100, and a;* = 200. 

Answer: 5. y 

A Exercise E7.5 

Determine n (the order) and the transfer function of a Chebyshev filter to meet the following 
specifications: r = 2 dB, = -20 dB, u p = 10 rad/s, and u> a ~ 28 rad/s. 

Answer: n = 2 

V 50.5823 

fils) — — '■ ■ 

O + 4.0191 -f- j6.8937)(s + 4.0191 

Hint: In this case K 2 = — y 

\A+« a 

7.6-1 Inverse Chebyshev Filters 

The passband behavior of the Chebyshev filters exhibits ripples and the stop- 
band is smooth. Generally, passband behavior is more important and we would 
prefer that the passband have smooth response. However, ripples can be tolerated 
in the stopband as long as they meet a given specification. The inverse Cheby- 
shev filter does exactly that. Both, the Butterworth and the Chebyshev filters, have 
finite poles and no finite zeros. The inverse Chebyshev has finite zeros and poles. 
It exhibits maximally flat passband response and equal-ripple stopband response. 

The inverse Chebyshev response can be obtained from the Chebyshev in two 
steps as follows: Let Hc{v) be the Chebyshev amplitude response given in Eq. 
(7.42). In the first step, we subtract |Wc(w)| 2 from 1 to obtain a highpass filter 
characteristic where the stopband (from 0 to 1) has ripples and the passband (from 
1 to oo) is smooth. In the second step, we interchange the stopband and passband 
by frequency transformation where ui is replaced by l/w. This step inverts the 
passband from the range 1 to oo to the range 0 to 1, and the stopband is now from 
1 to oo. Moreover, the passband is now smooth and the stopband has ripples. This 
is precisely the inverse Chebyshev amplitude response |W(u;)| given by 


50.5823 

- j6.8937) ~ s 1 + 8.03815 + 63.6768 


|« M | 2 = 1 -| H c ( 1 / o .)| 2 = 


t 2 C%( 1/qQ 
l + e*CZ(lM 


where C n (u) are the nth-order Chebyshev polynomials listed in Table 7.3. 

The inverse Chebyshev filters are preferable to the Chebyshev filters in many 
ways. For example, the passband behavior, especially for small w, is better for 
the inverse Chebyshev than for the Chebyshev or even for the Butterworth filter 
of the same order. The inverse Chebyshev also has the smallest transition band 
of the three filters. Moreover, the phase function (or time-delay) characteristic 
of the inverse Chebyshev filter is better than that of the Chebyshev filter. 2 Both 
the Chebyshev and inverse Chebyshev filter require the same order n to meet a 
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given set of specifications. 1 But the inverse Chebyshev realization requires more 
elements and thus is less economical than the Chebyshev filter. But the inverse 
Chebyshev does require fewer elements than a comparable performance Butterworth 
filter . Rather than give complete development of inverse Chebyshev filters, we shall 
solve a problem using MATLAB functions from the Signal Processing Toolbox. 

© Computer Example C7.9 

Design a lowpass inverse Chebyshev filter for the specifications in Example 7.7, using 
functions from Signal Processing Toolbox in MATLAB. 


is, 


Wp=10;Ws=16.5;Gp=-2;Gs=-20; 

[n,Ws]=cheb2ord(Wp,Ws,-Gp,-Gs,V); 

[num,den]=cheby2(n,-Gs,Ws,’s’) 

MATLAB returns n = 3 and num= 0 5 0 1805.9, den= 1 23.2 256.4 1805.9; that 

rj / , 5s 2 -t- 1805.9 

3 " s 3 + 23.2s 2 + 256.4s + 1805.9 


To plot amplitude response, we can use the last three functions from Example C7.5. © 


7.6-2 Elliptic Filters 


Recall our discussion in Sec. 7.4 that placing a zero on the imaginary axis (at 
s = ju) causes the gain (|HQ'w)|) to go to zero (infinite attenuation). We can realize 
a sharper cutoff characteristic by placing a zero (or zeros) near u = ui e . Butterworth 
and Chebyshev filters do not make use of zeros in H{s). But an elliptic filter does. 
This is the reason for the superiority of the elliptic filter. 

A Chebyshev filter has a smaller transition band compared to that of a Butter- 
worth filter because a Chebyshev filter allows rippling in the passband (or stopband). 
If we allow ripple in both the passband and the stopband, we can achieve further 
reduction in the transition band. Such is the case with elliptic (or Cauer) filters, 
whose normalized amplitude response is given by 

IWCMI = 

where R n (y>) is the nth-order Chebyshev rational function determined from the 
specific ripple characteristic. The parameter e controls the ripple. The gain at u p 
(w p = 1 for the normalized case) is G a . 

The elliptic filter is the most efficient if we can tolerate ripples in both the 
passband and the stopband. For a given transition band, it provides the largest 
ratio of the passband gain to stopband gain, or for a given ratio of passband to 
stopband gain, it requires the smallest transition band. In compensation, however, 
we must accept ripples in both the passband and the stopband. In addition, because 
of zeros in the numerator of Ti(s), the elliptic filter response decays at a slower rate 
at frequencies higher than u s . For instance, the amplitude response of a third- 
order elliptic filter decays at a rate of only —6 dB/octave at very high frequencies. 
This is because the filter has two zero and three poles. The two zeros increase 
the amplitude response at a rate of 12 dB/octave, and the three poles reduce the 
amplitude response at a rate of —18 dB/octave, thus giving a net decay rate of —6 
dB/octave. For the Butterworth and Chebyshev filters, there are no zeros in H(s). 
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Therefore, their amplitude response decays at a rate of -18 dB/octave. However, 
the rate of decay of the amplitude response is seldom important as long as we meet 
our specification, of a given G s at u>„. 

Calculation of pole-zero locations of elliptic filters is much more complicated 
than that in Butterworth or even Chebyshev filters. Fortunately, this task is greatly 
simplified by computer programs and extensive ready-made design Tables available 
in the literature. 3 The MATLAB function [z,p,k]=ellipap(n,-Gp,-Gs) in Signal Pro- 
cessing Toolbox determines poles, zeros, and the gain factor of a normalized analog 
elliptic lowpass filter of order n with a minimum passband gain Gp dB, and maxi- 
mum stopband gain Gs dB. The normalized passband edge is 1 rad/s. 

0 Computer Example C7.10 

Design the lowpass elliptic filter for the specifications in Example 7.7 using functions 
from Signal Processing Toolbox in MATLAB. 

Wp=10;Ws=16.5;Gp=-2;Gs=-20; 

[n,Wp]=ellipord(Wp,Ws,-Gp,-Gs,V); 

[mim,den]=ellip(n,-Gp,-Gs,Wp,V) 


MATLAB returns n = 3 and num= 0 2.7881 0 481.1626, den= 1 7.261 106.9991 
481.1626; that is, 

_ 2.7881s 2 + 481.1626 

s 3 + 7.261s 2 + 106.9991s + 481.1626 

To plot amplitude response, we can use the last three functions from Example C7.5. Q 


7.7 Frequency Transformations 

Earlier we saw how a lowpass filter transfer function of arbitrary specifications 
can be obtained from a normalized lowpass filter using frequency scaling. Using 
certain frequency transformations, we can obtain transfer functions of highpass, 
bandpass, and bandstop filters from a basic lowpass filter (the prototype filter) 
design. For example, a highpass filter transfer function can be obtained from the 
prototype lowpass filter transfer function by replacing s with m p /s. Similar transfor- 
mations allow us to design bandpass and bandstop filters from appropriate lowpass 
prototype filters. 

The prototype filter may be of any kind, such as Butterworth, Chebyshev, 
elliptic, and so on. We first design a suitable prototype lowpass filter H p (s). In 
the next step, we replace s with a proper transformation T(s) to obtain the desired 
highpass, bandpass, or bandstop filter. 

7.7-1 Highpass Filters 

Figure 7.27a shows an amplitude response of a typical highpass filter. The 
appropriate lowpass prototype response required for the design of a highpass filter 
in Fig. 7.27a is depicted in Fig. 7.27b. We must first determine this prototype filter 
transfer function ’H p (s) with the passband 0 < tu < 1 and the stopband u > ui p /uj s . 
The desired transfer function of the highpass filter to satisfy specifications in Fig. 
7.27a is then obtained by replacing s with T(s) in H p (s), where 
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I Example 7.8 

Design a Chebyshev highpass filter with the amplitude response specifications illus- 
trated in Fig. 7.28a with u a = 100, u p = 165, G a = 0.1(-20dB), and G p = 0.794 (-2 dB). 

Step 1: Determine the prototype lowpass filter 

The prototype lowpass filter has ui p - 1 and u, = 165/100 = 1.65. This means the 
prototype filter in Fig. 7.27b has a passband 0 < u < 1 and a stopband u t > 1.65, as 
shown in Fig. 7.28b. Also, G p = 0.794 (-2dB) and G s = 0.1 (-20dB). We already 
designed a Chebyshev filter with these specifications in Example 7.7. The transfer 
function of this filter is [Eq. (7.54)] 



(0 -» 


co — > 


Fig. 7.28 Highpass Filter Design for Example 7.8. 
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s 3 + 0.7378s 2 + 1.0222s + 0.3269 

The amplitude response of this prototype filter is depicted in Fig. 7.28b. 

Step 2: Substitute s with T(s) in 7i p (s) 

The de^red highpass filter transfer function H(s) is obtained from W„(s) by replacing 
s with T(s) = uip / s = 165/s. Therefore 8 


M M = 


+ 0.7378 (If) 2 + 1.0222(lf ) + 0.3269 


s 3 + 515.94s 2 + 61445.75s + 13742005 

The amplitude response \H(jw)\ for this filter is illustrated in Fig. 7.28a. ■ 

o Computer Example C7.ll 

Design the highpass filter for the specifications in Example 7.8 using functions from 
types of T °° b ° X m MATLAB - We shall give here MATLAB functions for all 

Ws=100;Wp=165;Gp=-2;Gs=-20; 

7. Butterworth 

[n,Wn]=buttord(Wp,Ws,-Gp,-Gs, ’s’) 

[num,den] = butter(n,Wn,’high’,’s’) 

7. Chebyshev 

[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs,V) 

Jnum,den]=chebyl(n,-Gp,Wn,’high’,’s’) 

7» Inverse Chebyshev 

[n,Wn]=cheb2ord(Wp,Ws,-Gp,-Gs,’s’) 

[num,den]=cheby2(n,-Gs,Wn,’high’,’s’) 

7. Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs,V) 

[num,den]=ellip(n,-Gp,-Gs,Wn,’high’,’s’) 

To plot amplitude response, we can use the last three functions in Example C7.5. © 

7.7-2 Bandpass Filters 

Figure 7.29a shows an amplitude response of a typical bandpass filter. To 
design such a filter, we first find H p {s), the transfer function of a prototype lowpass 
ter, to meet the specifications in Fig. 7.29b, where u> s is given by the smaller of 

or f , 

1 ( W P2 W Pl ) U> S2 (Up 2 ~ W ?1 ) ' 

Now, the desired transfer function of the bandpass filter to satisfy the specifi- 
cations in Fig. 7.29a is obtained from H p (s) by replacing s with T(s), where 


T(s) = 


s- + U1 P1 W P2 
(uip 2 - u; pi )s 
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Fig. 7.29 Frequency transformation for bandpass filters. 

I Example 7.9 

Design a Chebyshev bandpass filter with the amplitude response specifications shown 
in Fig. 7.30a with u Vl = 1000, = 2000, ui 31 = 450, ui, 2 = 4000, G, = 0.1 (-20dB) 

and G r = 0.891 (-1 dB). Observe that for Chebyshev filter, G p = -1 dB is equivalent to 
r = 1 dB. 

The solution is executed in two steps: in the first step, we determine the lowpass 
prototype filter transfer function H p (s). In the second step, the desired bandpass filter 
transfer function is obtained from H p (a) by substituting s with T(s), the lowpass to 
bandpass transformation in Eq. (7.57). 

Step 1: Find W p (s), the lowpass prototype filter transfer function. 

This is done in 3 substeps as follows: 

Step 1.1: Find u s for the prototype filter. 

The frequency u, is found [using Eq. (7.56)], to be the smaller of 



0 1000 2000 4000 6000 8000 0 1 2 3 3 5 4 5 


0) —> 

Fig. 7.30 Chebyshev Bandpass Filter Design for Example 7.9. 
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(100Q)(2000) - (450) 2 (4000) 2 - (1000)(2000) 

450(2000 - 1000) an 4000(2000 - 1000) ~ 3,5 

which is 3.5. 

Step 1.2: Determine n 

We now need to design a prototype lowpass filter in Fig. 7.29b with G p = -1 dB, 
G s = -20 dB, u p = 1, and u, = 3.5, as illustrated in Fig. 7.30b. The Chebyshev 
filter order n required to meet these specifications is obtained from Eq. (7.49b) (or 
Eq. (7.49a) because, in this case, u p = 1), as 

1 , _! T 10 2 - 1 1 * 

n = — r cosh — — = 1.904 

cosh -1 (3.5) [10 01 -1 

a result, which is rounded up to n = 2. 

Step 1.3: Determine the prototype filter transfer function H p (s) 

We can obtain the transfer function of the second-order Chebyshev filter by computing 
its poles for n = 2 and f = 1 (e = 0.5088) using Eq. (7.51). However, since Table 
7.4 lists the denominator polynomial for r — 1 and n = 2, we need not perform the 
computations and may use the ready-made transfer function directly as 

_ 0.9826 

P S s 2 + 1.0977s + 1.1025 ^ 7 ' 58 ^ 

Here we used Eq. (7.53) to find the numerator K n = ^ = 0.9826. The 

amplitude response of this prototype filter is depicted in Fig. 7.30b. 

Step 2: Find the desired bandpass filter transfer function H(s) using the 
lowpass to bandpass transformation. 

Finally, the desired bandpass filter transfer function H(s) is obtained from H p (s) by 
replacing s with T(s), where (see Eq. (7.57)] 


T(s) = 


s 2 + 2(10) 6 
1000s 


Replacing s with T(s) in the right-hand side of Eq. (7.58) yields the final bandpass 
transfer function 


ms) = 9.826(10) 5 s 2 

s 4 + 1097.7s 3 4- 5.1025(10) 6 s 2 + 2.195(10) 9 s + 4(10) 12 

The amplitude response |H(jo>)| of this filter is shown in Fig. 7.30a. ■ 


We may use a similar procedure for the Butterworth filter. Compared to Cheby- 
shev design, Butterworth filter design involves two additional steps. First, we need 
to compute the cutoff frequency u c of the prototype filter. For a Chebyshev filter, 
the critical frequency happens to the frequency where the gain is G p . This frequency 
is u = 1 in the prototype filter. For Butterworth, on the other hand, the critical 
frequency is the half power (or 3 dB-cutoff) frequency u c , which is not necessarily 
the frequency where the gain is G p . To find the transfer function of the Butterworth 
prototype filter, it is essential to know u c . Once we know w c , the prototype filter 
transfer function is obtained by replacing s with s/u c in the normalized transfer 
function H(s). This step is also unnecessary in the Chebyshev filter design. We 
shall demonstrate the procedure for the Butterworth filter design by an example 
below. 
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Fig. 7.31 Butterworth Bandpass Filter Design for Example 7.10. 


M Example 7.10 

Design a Butterworth bandpass filter with the amplitude response specifications il- 
lustrated in Fig. 7.31a with u PJ = 1000, u P2 = 2000, u Sl = 450, u S2 = 4000, G p = 
0.7586(— 2.4dB), and G„ = 0.1 (-20dB). 

As in the previous example, the solution is executed in two steps: in the first step, 
we determine the lowpass prototype filter transfer function H p {s). In the second step, the 
desired bandpass filter transfer function is obtained from H p (s) by substituting s with 
T(s), the lowpass to bandpass transformation in Eq. (7.57). 

Step 1: Find 7f p (s), the lowpass prototype filter transfer function. 

This goal is accomplished in 5 substeps used in the design of the lowpass Butterworth 
filter (see Example 7.6): 

Step 1.1: Find u a for the prototype filter. 

For the prototype lowpass filter transfer function Ti p (s) with the amplitude response 
shown in Fig. 7.31b, the frequency u a is found [using Eq. (7.56)] to be the smaller of 

(1000)(2000) - (450) 2 _ , nn J (4000) 2 - (1000)(2000) „ „ 

450(2000 - 1000) anC1 4000(2000- 1000) 

which is 3.5, as depicted in Fig. 7.31b. 

Step 1.2: Determine n 

For a prototype lowpass filter in Fig. 7.29b, G p = -2.4 dB, G s = -20 dB, u p = 1, 
and u, = 3.5. Hence, according to Eq. (7.39), the Butterworth filter order n required 
to meet these specifications is 



which is rounded up to n = 2. 


10 2 - 1 
1QO-24 _ J 
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Step 1.3: Determine u> c 

In this step (which is not necessary for the Chebyshev design), we determine the 3 
dB cutoff frequency u> c for the prototype filter. Use of Eq. (7.41) yields 


Uc ~ ( 10 * - l ) ' 1 / 4 = 10958 


Step 1.4: Determine the normalized transfer function Ti(s) 

The normalized second-order lowpass Butterworth transfer function from Table 7.1 


s 2 + V2s + 1 

This is the transfer function of a normalized filter (meaning that io c = 1). 

Step 1.5: Determine the prototype filter transfer function W p (s) 

The prototype filter transfer function H p (s) is obtained by substituting s with sj tn c = 
s/1.10958 in the normalized transfer function Tt{s) found in step 1.4 as 


n p (s) = 


(1.10958) 2 

s 2 + \/2(1.10958)s + (1.10958) 2 


s 2 + 1.5692s + 1.2312 


The amplitude response of this prototype filter is illustrated in Fig. 7.31b. 

Step 2: Find the desired bandpass filter transfer function H(s) using the 
lowpass to bandpass transformation. 

Finally the desired bandpass filter transfer function H{s) is obtained from 'Hp(s) by 
replacing s with T(s), where [see Eq. (7.57)] 

T(s) = s2 + 2(10)6 
V 1 1000s 

Replacing s with T(s) in the right-hand side of Eq. (7.59) yields the final bandpass 
transfer function 

v = 1.2312(10)S 2 

( 1 s 4 + 1569 s 3 + 5.2312(10) 6 s 2 + 3.1384(10) 9 s + 4(10) 12 


The amplitude response \H(ju>)\ of this filter is shown in Fig. 7.31a. I 

O Computer Example C7.12 

Design a bandpass filter for the specifications in Example 7.10 using functions from 
Signal Processing Toolbox in MATLAB. We shall give here MATLAB functions for the 
four types of filters. 

For bandpass filters, we use the same functions as those used for lowpass filter in 
Examples C7.6, C7.8-C7.10, with one difference: Wp and Ws are 2 element vectors as 
Wp=[Wpl Wp2], Ws=[Wsl Ws2]. 

Wp=[lO00 2000];Ws=[450 4000];Gp=-2.4;Gs=-20; 

'/. Butterworth 

[n,Wn]=buttord(Wp,Ws,-Gp,-Gs,’s’) 

[num,den]=butter(n,Wn,’s’) 

'/, Chebyshev 

[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs,’s’); 

[num,den]=chebyl(N,-Gp,Wn,’s’) 
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‘/. Inverse Chebyshev 
[n,Ws]=cheb2ord(Wp,Ws,-Gp,-Gs,V); 

[num,den]=cheby2(n,-Gs,Ws,’s’) 

% Elliptic filter 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs,V); 

[num,den]=ellip(n,-Gp,-Gs,Wn,’s’) Q 

To plot amplitude response, we can use the last three functions from Example 
C7.5. 

7.7-3 Bandstop Filters 

Figure 7.32a shows an amplitude response of a typical bandstop filter. To 
design such a filter, we first find H p (s), the transfer function of a prototype lowpass 
filter, to meet the specifications in Fig. 7.32b, where u s is given by the smaller of 

K: - or K (7. 60 ) 

UJ P1 U1 P2 - w s , 2 U1 S S - UJ pi U)p 2 

The desired transfer function of the bandstop filter to satisfy the specifications 
in Fig. 7.32a is obtained from H p {s) by replacing a with T(s), where 



Fig. 7.32 Frequency transformation for bandstop filters. 

I Example 7.11 

Design a Butterworth bandstop filter with the specifications depicted in Fig. 7.33a 
with w pi = 60, u P2 = 260, w Sl = 100, = 150, G p = 0.776 (-2.2 dB), and G a = 

0.1 (-20 dB). 

In the first step we shall determine the prototype lowpass filter transfer function 
K p (s), and in the second step we use the lowpass to bandstop transformation in Eq. (7.61) 
to obtain the desired bandstop filter transfer function H{s). 

Step 1: Find 7 t p (s), the lowpass prototype filter transfer function. 

This goal is accomplished in 5 substeps used in the design of the lowpass Butterworth 
filter (see Example 7.6): 


I 
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I (j co) I 



60 100 150 200 260 


Fig. 7.33 Butterworth Bandstop Filter Design for Example 7.11. 

Step 1.1: Find ui a for the prototype filter. 

For the prototype lowpass filter transfer function H p (s) with the specifications illus- 
trated in Fig. 7.32b, the frequency u, is found (using Eq. (7.60)] to be the smaller 
of 

(100)(260 - 60) , 150(260-60) 

(260) (60) - 100 2 - 3 ' and 150 2 - (260) (60) “ 4 347 
which is 3.57, as shown in Fig. 7.33b. 

Step 1.2: Determine n 

For the prototype lowpass filter in Fig. 7.33b, G p = -2.2 dB, G„ = -20 dB, ui p = 1, 
and u, = 3.57. According to Eq. (7.39), the Butterworth filter order n required to 
meet these specifications is 


= 1.9689 


2 log(3.57) I 10° 22 -1 


We round up the value of n to 2. 

Step 1.3: Determine u> c 

The half power frequency u c for the prototype Butterworth filter, using Eq. (7.40) 
with Up = 1, is 

= 7 TT~ T = ~ r = 11096 

( 10 -G P /io_ i)| (10°- 22 - l)i 


Step 1.4: Determine the normalized transfer function 

The transfer function of the second-order normalized Butterworth filter from the 
Table 7.1 is 

H[s) = — (7.62) 

s 2 + V2s + 1 K ' 
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Step 1.5: Determine the prototype filter transfer function Tipis) 

The prototype filter transfer function H P (s) is obtained by substituting s with s/w c - 
s/1.1096 in the normalized transfer function 7 i(s) in step 1.4. This move yields 

1 1.2312 

~ (^) 2 + \/2^ + l = s 2 + 1.5692s + 1.2312 ^ 7 ' 63 ^ 

The amplitude response of this prototype filter is depicted in Fig. 7.33b. 

Step 2: Find the desired bandstop filter transfer function H(s) using the 
lowpass to bandstop transformation 

Finally, the desired transfer function H(s) of the bandpass filter with specifications 
illustrated in Fig. 7.33a is obtained from W p (s) by replacing s with T(s), where (see 
Eq. (7.61)] 


T(s) 


200 s 

s 2 + 15, 600 


Replacing s with T(s) in the right-hand side of Eq. (7.63) yields the final bandstop 
transfer function 


, 1.2312 

(^5o) 2 + 1-5692(^^5) + 1.2312 

(s 2 + 15600) 2 

s 4 + 254.9s 3 + 63690.9s 2 + (3.977)10 6 s + (2.433)10® 

The amplitude response is shown in Fig. 7.33a. ■ 

O Computer Example C7.13 

Design the bandstop filter for the specifications in Example 7.11 using functions from 
Signal Processing Toolbox in MATLAB. We shall give here MATLAB functions for all the 
four types of filters. 

Wp=[60 260]; Ws=[100 150]; Gp=-2.2;Gs=-20; 

7, Butterworth 

[n,Wn]=buttord(Wp,Ws,-Gp,-Gs,’s’) 

[num,den]=butter(n,Wn,’stop’,’s’) 

% Chebyshev 

[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs,V) 

[num,den]=chebyl(n,-Gp,Wn,’stop’,’s’) 

7. Inverse Chebyshev 
(n,Wn]=cheb2ord(Wp,Ws,-Gp,-Gs,V) 

[num,den]=cheby2(n,-Gs,Wn,’stop’,V) 

7. Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs,’s’) 
inum,den]=ellip(n,-Gp,-Gs,Wn,’stop’,’s’) Q 


7.8 Filters to Satisfy Distortionless transmission Conditions 

The purpose of a filter is to suppress unwanted frequency components and 
to transmit the desired frequency components without distortion. In Sec. 4.4, we 
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saw that this requires the filter amplitude response to be constant and the phase 
response to be a linear function of ui over the passband. 

The filters discussed so far have stressed the constancy of the amplitude re- 
sponse. The linearity of the phase response has been ignored. As we saw earlier, 
the human ear is sensitive to amplitude distortion but somewhat insensitive to 
phase distortion. For this reason filters in audio application are designed primar- 
ily for constant amplitude response, and the phase response is only a secondary 
consideration. 

We also saw earlier that the human eye is sensitive to phase distortion and 
relatively insensitive to amplitude distortion. Therefore, in video applications we 
cannot ignore phase distortion. In pulse communication, both the amplitude and 
the phase distortion are important for correct information transmission. Thus, 
in practice, we also need to design filters primarily for phase linearity in video 
applications. In pulse communication applications, it is important to have filters 
with constant amplitude response and a linear phase response. We shall briefly 
discuss some aspects and approaches to the design of such filters. More discussion 
appears in the literature. 2 

We showed [see Eq. (4.59)] that the time delay t d resulting from the signal 
transmission through a filter is the negative of the slope of the filter phase response 
/.H(jui)-, that is, 

t d {u) = -^-lH(ju) (7.64) 

au) 

If the slope of IH(ju) is constant over the desired band (that is, if lH{ju) is linear 
with ut), all the components are delayed by the same time interval t d . In this case 
the output is a replica of the input, assuming that all components are attenuated 
equally; that is, |/f(jw)| = constant over the passband. 

If the slope of the phase response is not constant, tj., the time delay, varies 
with frequency. This variation means that different frequency components undergo 
different amounts of time delay, and consequently the output waveform will not 
be a replica of the input waveform even if the amplitude response is constant over 
the passband. A good way of judging phase linearity is to plot t d as a function of 
frequency. For a distortionless system, t d (the negative slope of LH(ju)) should 
be constant over the band of interest. This is in addition to the requirement of 
constancy of the amplitude response. 

Generally speaking, the two requirements of distortionless transmission conflict. 
The more we approach the ideal amplitude response, the further we deviate from the 
ideal phase response. The sharper the cutoff characteristic (smaller the transition 
band), the more nonlinear is the phase response near the transition band. We 
can verify this fact from Fig. 7.34, which shows the delay characteristic of the 
Butterworth and the Chebyshev family of filters. The Chebyshev filter, which has a 
sharper cutoff than that of the Butterworth, shows considerably more variation in 
time delay of various frequency components as compared to that of the Butterworth. 

For the applications where the phase linearity is also important, there are two 
possible approaches: 

1 If td = constant (phase linearity) is the primary requirement, we design a filter 
for which t d is maximally flat around ui = 0 and accept the resulting ampli- 
tude response, which may not be so flat nor have a sharp cutoff characteristic. 



(0 — » 


Fig. 7.34 Delay characteristics of the Butterworth and Chebyshev filters. 

Contrast this with the Butterworth filter, which is designed to yield the max- 
imally flat amplitude response at a; = 0 without any attention to the phase 
response. A family of filters which yields a maximally flat t d goes under the 
name Bessel-Thomson filters, which uses the nth-order Bessel polynomial 
in the denominator of nth-order H(s). 

2 If both amplitude and phase response are important, we start with a filter to 
satisfy the amplitude response specifications, disregarding the phase response 
specifications. We cascade this filter with another filter, an equalizer, whose 
amplitude response is flat for all frequencies (the allpass filter) and whose 
td characteristic is complementary to that of the main filter in such a way that 
their composite phase characteristic is approximately linear. The cascade thus 
has linear phase and the amplitude response of the main filter (as required). 

Allpass Filters 

An allpass filter has equal number of poles and zeros. All the poles are in the 
LHP (left half plane) for stability. All the zeros are mirror images of the poles about 
the imaginary axis. In other words, for every pole at -a + jb , there is a zero at 
a + jb. Thus, all the zeros are in the RHP. Any filter with this kind of pole-zero 
configuration is an allpass filter; that is, its amplitude response is constant for all 
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frequencies. We can verify this assertion by considering a transfer function with a 
pole at -a + jb and a zero at a + jb: 

H (s) = and H[j u ) = I z Jl = ^ ~ b ) 

s 4- a — jb ju + a — jb a + — b) 


Therefore 




/(-a) 2 + (<J - b) 2 
\/a 2 + (tu - b) 2 


, , , , u> — b u> — 6 

IH(juj) — tan -tan 

—a J L a 

iW — 6 iW — 6 -t u> — b 

= rr - tan 1 — - — -tan 1 = rr-2tan 1 (7.66) 

a a J [ a 

Observe that although the amplitude response is unity regardless of pole-zero 
locations, the phase response depends on the locations of poles (or zeros). By 
placing poles in proper locations, we can obtain a desirable phase response that is 
complementary to the phase response of the main filter. 


7.9 Summary 

The response of an LTIC system with transfer function H(s) to an everlasting 
sinusoid of frequency ui is also an everlasting sinusoid of the same frequency. The 
output amplitude is \H(ju)\ times the input amplitude, and the output sinusoid is 
shifted in phase with respect to the input sinusoid by IH(jui) radians. The plot of 
\H(ju>)\ vs oj indicates the amplitude gain of sinusoids of various frequencies and 
is called the amplitude response of the system. The plot of LH(jui ) vs u indicates 
the phase shift of sinusoids of various frequencies and is called the phase response. 

Plotting of the frequency response is remarkably simplified by using logarithmic 
units for amplitude as well as frequency. Such plots are known as the Bode plots. 
The use of logarithmic units makes it possible to add (rather than multiply) the 
amplitude response of four basic types of factors that occur in transfer functions: 
(1) a constant (2) a pole or a zero at the origin (3) a first order pole or a zero, 
and (4) complex conjugate poles or zeros. For phase plots, we use linear units for 
phase and logarithmic units for the frequency. The phases corresponding to the 
three basic types of factors mentioned above add. The asymptotic properties of the 
amplitude and phase responses allow their plotting with remarkable ease even for 
transfer functions of high orders. 

The frequency response of a system is determined by the locations in the com- 
plex plane of poles and zeros of its transfer function. We can design frequency 
selective filters by proper placement of its transfer function poles and zeros. Plac- 
ing a pole (a zero) near a frequency juio in the complex plane enhances (suppresses) 
the frequency response at the frequency u> = u>o- With this concept, a proper combi- 
nation of poles and zeros at suitable locations can yield desired filter characteristics. 

Two families of analog filters are considered: Butterworth and Chebyshev. 
The Butterworth filter has a maximally flat amplitude response over the passband. 
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The Chebyshev amplitude response has ripples in the passband. On the other 
hand, the behavior of the Chebyshev filter in the stopband is superior to that of 
the Butterworth filter. The design procedure for lowpass filters can be readily 
applied to highpass, bandpass, and bandstop filters by using appropriate frequency 
transformations discussed in Sec. 7.7. 

Allpass filters have a constant gain but a variable phase with respect to fre- 
quency. Therefore, placing an allpass filter in cascade with a system leaves its 
amplitude response unchanged, but alters its phase response. Thus, an allpass filter 
can be used to modify the phase response of a system. 
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Problems 


7.1-1 For an LTIC system described by the transfer function 


H(s) 


s + 2 

s 2 + 5s + 4 


find the response to the following everlasting sinusoidal inputs: (a) 5cos(2t + 
30°) (b) 10sin(2t + 45°) (c) lOcos (3t + 40°). Observe that these are everlasting 
sinusoids. 

7.1-2 For an LTIC system described by the transfer function 


H(s) 


s + 3 


find the steady-state system response to the following inputs: 

(a) 10u(t) (b) cos (2t + 60°)u(t) (c) sin (3t - 45°)u(t) (d) e j3t u(t) 

7.1-3 For an allpass filter specified by the transfer function 


H(s) 


s + 10 


find the system response to the following (everlasting) inputs: (a) e J "‘ (b) cos ( u>t+8 ) 
(c) cos t (d) sin 2t (e) cos lOt (f) cos lOOt. 

Comment on the filter response. 

7.2-1 Sketch Bode plots for the following transfer functions: 

s(s + 100) (s + 10)(s + 20) (s + 10)(s + 200) 

W (s + 2)(s + 20) V ’ s 2 (s + 100) (s + 20) 2 (s + 1000) 
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Fig. P7.3-1 


7.2- 2 Repeat Prob. 7.2-1 if 

s 2 s , . (s + 10) 

( a ) ( s + l )( s 2 + 4 S + 16) ' b ' (s + l)(s 2 + 14.14s + 100) 1 s(s 2 + 14.14s + 100) 

7.3- 1 Feedback can be used to increase (or decrease) the system bandwidth. Consider a 

system in Fig. P7.3-la with transfer function G(s) — 77 ^ 7 - 

(a) Show that the 3 dB bandwidth of this system is u c . 

(b) To increase the bandwidth of this system, we use negative feedback with H(s) = 9, 
as depicted in Fig. P7.3-lb. Show that the 3 dB bandwidth of this system is 10u e . 

(c) To decrease the bandwidth of this system, we use positive feedback with H(a) = 
-0.9, as illustrated in Fig. P7.3-lc. Show that the 3 dB bandwidth of this system is 

(d) The system gain at dc times its 3 dB bandwidth is called the gam-bandwidth 
product of a system. Show that this product is the same for all the three systems in 
Fig. P7.3-1. This result shows that if we increase the bandwidth, the gain decreases 
and vice versa. 

7 4-1 Using the graphical method of Sec 7.4-1, draw a rough sketch of the amplitude and 
phase response of an LTIC system described by the transfer function 

, s 2 — 2s + 50 (a — 1 — J'7)(a — 1 + j7) 

ff ^ _ s 2 + 2s + 50 (a + 1 — j’7)(s + 1 + j7) 

What kind of filter is this? 


s plane 


t t 



(a) (b) 


Fig. P7.4-2 
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7.4- 2 Using the graphical method of Sec. 7.4-1, draw a rough sketch of the amplitude and 

phase response of LTIC systems whose pole-zero plots are shown in Fig. P7.4-2. 

7.4- 3 Design a second-order bandpass filter with center frequency u = 10. The gain should 

be zero at u — 0 and at tv = 00 . Select poles at —a ± y‘10. Leave your answer in 
terms of a. Explain the influence of a on the frequency response. 

7.5- 1 Determine the transfer function H(s) and the amplitude response H(ju) for a third- 

order lowpass Butterworth filter if the 3 dB cutoff frequency u c = 100. Find your 
answer without using Tables 7.1 or 7.2. Verify your answer using either of these 
Tables. 

7.5- 2 Determine n, the order of a lowpass Butterworth filter, and the corresponding cutoff 

frequency u c required to satisfy the following lowpass filter specifications. Find both 
the values of u c , the one that oversatisfies the passband specifications, and the one 
that oversatisfies the stopband specifications. 

(a) G p > -0.5 dB, G, < -20 dB, u> p = 100 rad/s, and u, = 200 rad/s. 

(b) G p > 0.9885, G, < 10~ 3 , u p = 1000 rad/s, and u, = 2000 rad/s. 

(c) The gain at 3u c is required to be no greater than -50 dB. 

7.5- 3 Find the transfer function H(s) and the amplitude response H(ju :) for a lowpass 

Butterworth filter to satisfy the specifications: G p > —3 dB, Gs < —14 dB, u p = 
100,000 rad/s, and u, = 150,000 rad/s. It is desirable to oversatisfy (if possible) the 
requirement of G s - Determine the Gp and G s of your design. 

7.6- 1 Repeat Prob. 7.5-1 for a Chebyshev filter. Do not use Tables. 

7.6- 2 Design a lowpass Chebyshev filter to satisfy the specifications: Gp > -1 dB, G , < 

-22 dB, u>p = 100 rad/s, and u, = 200 rad/s. 

7.6- 3 Design a lowpass Chebyshev filter to satisfy the specifications: G p > —2 dB, Gs < 

-25 dB, Up = 10 rad/s, and u, = 15 rad/s. 

7.6- 4 Design a lowpass Chebyshev filter whose 3 dB cutoff frequency is u c , and the gain 

drops to —50 dB at 3o> 0 . 

7.7- 1 Find the transfer function H(s) for a highpass Butterworth filter to satisfy the spec- 

ifications: G 3 < —20 dB, G p > —1 dB, u s — 10, and u p = 20. 

7.7- 2 Find the transfer function H(s) for a highpass Chebyshev filter to satisfy the speci- 

fications: G a < -22 dB, G p > -1 dB, u, = 10, and u p = 20 

7.7- 3 Find the transfer function H ( s ) for a Butterworth bandpass filter to satisfy the spec- 

ifications: Gs < -17 dB, Gp > -3 dB, u pi = 100 rad/s, u P2 = 250 rad/s, and 
w si = 40 rad/s, u, 2 = 500 rad/s. 

7.7- 4 Find the transfer function H(s) for a Chebyshev bandpass filter to satisfy the speci- 

fications: G s < -17 dB, f < 1 dB, u vi = 100 rad/s, u P2 = 250 rad/s, and u si = 40 
rad/s, Us 2 = 500 rad/s. 

7.7- 5 Find the transfer function H (s) for a Butterworth bandstop filter to satisfy the speci- 

fications: G s < -24 dB, Gp > -3 dB, u pi = 20 rad/s, u P2 = 60 rad/s, and w n = 30 
rad/s, u, 3 = 38 rad/s. 
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Discrete-Time 
Signals and Systems 


In this chapter we introduce the basic concepts of discrete-time signals and 
systems. 


8.1 Introduction 

Signals specified over a continuous range of t are continuous-time signals, 
denoted by the symbols f(t),y(t), etc. Systems whose inputs and outputs are 
continuous-time signals are continuous-time systems. In contrast, signals defined 
only at discrete instants of time are discrete-time signals. Systems whose inputs 
and outputs are discrete-time signals are called discrete-time systems. A digital 
computer is a familiar example of this type of system. We consider here uniformly 
spaced discrete instants such as ... , -2 T, -T, 0, T, 2 T, 3 T, .... kT, . . .. Discrete- 
time signals can therefore be specified as f(kT), y{kT), and so on ( k , integer). 
We further simplify this notation to /[fc], y [fc], etc., where it is understood that 
/ [*] = f(kT) and that k is an integer. A typical discrete-time signal, depicted in 
Fig. 8.1, is therefore a sequence of numbers. This signal may be denoted by f(kT) 
and viewed as a function of time t where signal values are specified at t = kT. 
It may also be denoted by /[fc] and viewed as a function of k ( k , integer). For 
instance, a continuous-time exponential f(t) = e~ t , when sampled every T = 0.1 
second, results in a discrete-time signal /(fcT) given by 

f(kT ) = e~ kT = e~°' lk 

Clearly, this signal is a function of k and may be expressed as f{k]. We can plot this 
signal as a function of t or as a function of k (fc, integer). The representation /[fc] is 
more convenient and will be followed throughout this book. A discrete-time signal 
therefore may be viewed as a sequence of numbers, and a discrete-time system may 
be seen as processing a sequence of numbers /[fc] and yielding as output another 
sequence of numbers y[fc]. 



Fig. 8.1 A discrete-time signal. 


Discrete-time signals arise naturally in situations which are inherently discrete- 
time, such as population studies, amortization problems, national income models, 
and radar tracking. They may also arise as a result of sampling continuous-time 
signals in sampled data systems, digital filtering, and so on. Digital filtering is a 
particularly interesting application in which continuous-time signals are processed 
by discrete-time systems, using appropriate interfaces at the input and output, as 
illustrated in Fig. 8.2. A continuous-time signal /(<) is first sampled to convert it 
into a discrete-time signal /[fc], which is then processed by a discrete-time system 
to yield the output y[fc], A continuous-time signal y(t) is finally constructed from 
y[fcj. We shall use the notations C/D and D/C for continuous-to-discrete-time and 
discrete-to-continuous-time conversion. Using the interfaces in this manner, we can 
process a continuous-time signal with an appropriate discrete-time system. As we 
shall see later in our discussion, discrete-time systems have several advantages over 
continuous-time systems. For this reason, there is an accelerating trend toward 
processing continuous-time signals with discrete-time systems. 



Fig. 8.2 Processing a continuous-time signal by a discrete-time system. 


8.2 Some Useful Discrete-Time Signal Models 


We now discuss some important discrete-time signal models which are encoun- 
tered frequently in the study of discrete-time signals and systems. 
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Fig. 8.3 Discrete-time impulse function. 


1. Discrete-Time Impulse Function <5[fc] 

The discrete-time counterpart of the continuous-time impulse function 6(t) is 


<5 [fc] , defined by 



k = 0 
k 5^0 


( 8 . 1 ) 


This function, also called the unit impulse sequence, is shown in Fig. 8.3a. The time- 
shifted impulse sequence S[k — m] is depicted in Fig. 8.3b. Unlike its continuous-time 
counterpart S(t), this is a very simple function without any mystery. 

Later, we shall express an arbitrary input /[A:] in terms of impulse components. 
The (zero-state) system response to input f[k] can then be obtained as the sum of 
system responses to impulse components of f[k]. 


2. Discrete-Time Unit Step Function u[k] 

The discrete-time counterpart of the unit step function u(t) is u[k ] (Fig. 8.4), 


defined by 



for k > 0 
for fc < 0 


( 8 . 2 ) 


If we want a signal to start at k = 0 (so that it has a zero value for all k < 0), 
we need only multiply the signal with u[fc]. 



-2 0 1 2 3 4 5 6 k- 


Fig. 8.4 A discrete-time unit step function u[fc]. 
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( a ) (b) 

Fig. 8.5 The A-plane, the 7 -plane and their mapping. 


3. Discrete-Time Exponential -y k 

A continuous-time exponential e* 4 can be expressed in an alternate form as 

e At = 7 ‘ (7 = e x or A = ln7) (8.3a) 

For example, e -0 ' 34 = (0.7408) 4 because e -0 ' 3 = 0.7408. Conversely, 4* = e 1 ' 3864 
because In 4 = 1.386, that is, e 1,386 = 4. In the study of continuous-time signals 
and systems we prefer the form e Xt rather than 7*. The discrete-time exponential 
can also be expressed in two forms as 

e Xk = 7 fc (7 = e* or A = In 7) (8.3b) 

For example, e 3k = (e 3 ) k = (20.086) fc . Similarly, 5 k = e 1 - 609 * because 5 = e 1609 . 
In the study of discrete-time signals and systems, unlike the continuous-time case, 
the form -y k proves more convenient than the form e xk . Because of unfamiliarity 
with exponentials with bases other than e, exponentials of the form -y k may seem 
inconvenient and confusing at first. The reader is urged to plot some exponentials 
to acquire a sense of these functions. 

Nature of 7*: The signal e xk grows exponentially with fc if Re A > 0 (A in 
RHP), and decays exponentially if Re A < 0 (A in LHP). It is constant or oscillates 
with constant amplitude if Re A = 0 (A on the imaginary axis). Clearly, the location 
of A in the complex plane indicates whether the signal e xk grows exponentially, 
decays exponentially, or oscillates with constant frequency (Fig. 8.5a). A constant 
signal (A = 0) is also an oscillation with zero frequency. We now find a similar 
criterion for determining the nature of y k from the location of 7 in the complex 
plane. 

Figure 8.5a shows a complex plane (A-plane). Consider a signal e iVtk . In this 
case, A = jfi lies on the imaginary axis (Fig. 8.5a), and therefore is a constant- 
amplitude oscillating signal. This signal &i nk can be expressed as 7 k , where 7 = e jfi . 
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Because the magnitude of e jC1 is unity, |-y | = 1. Hence, when A lies on the imaginary 
axis, the corresponding 7 lies on a circle of unit radius, centered at the origin (the 
unit circle illustrated in Fig. 8.5b). Therefore, a signal 7* oscillates with constant 
amplitude if 7 lies on the unit circle. Remember, also, that a constant signal 
(A = 0, 7 = 1) is an oscillating signal with zero frequency. Thus, the imaginary axis 
in the A-plane maps into the unit circle in the 7-plane. 

Next consider the signal e A *, where A lies in the left-half plane in Fig. 8.5a. 
This means A = a + jb, where a is negative (a < 0). In this case, the signal decays 
exponentially. This signal can be expressed as 7*, where 

7 = e A = e a+jb = e° e ib 

and 

|7 1 = |e a | = e a because |e jb | = 1 

Also, a is negative (a < 0). Hence, I7I = e° < 1. This result means that the cor- 
responding 7 lies inside the unit circle. Therefore, a signal 7* decays exponentially 
if 7 lies within the unit circle (Fig. 8.5b). If, in the above case we had selected a 
to be positive, (A in the right-half plane), then |7| > 1, and 7 lies outside the unit 
circle. Therefore, a signal 7* grows exponentially if 7 lies outside the unit circle 
(Fig. 8.5b). 

To summarize, the imaginary axis in the A-plane maps into the unit circle in the 
7-plane. The left-half plane in the A-plane maps into the inside of the unit circle and 
the right-half of the A-plane maps into the outside of the unit circle in the 7-plane, 
as depicted in Fig. 8.5. This fact means that the signal -y k grows exponentially with 
A if 7 is outside the unit circle (|7| > 1), and decays exponentially if 7 is inside the 
unit circle (|t| < 1). The signal is constant or oscillates with constant amplitude if 
7 is on the unit circle ((7 1 = 1). 

Observe that 



Figures 8.6a and 8.6b show plots of (0.8) fc , and ( — 0.8) fc , respectively. Figures 
8.6c and 8.6d show plots of (0.5)*, and (1.1)*, respectively. These plots verify our 
earlier conclusions about the location of 7 and the nature of signal growth. Observe 
that a signal (—7)* alternates sign successively (is positive for even values of fc and 
negative for odd values of fc, as depicted in Fig. 8.6b). Also, the exponential (0.5)* 
decays faster than (0.8)*. The exponential (0.5)* can also be expressed as 2~* 
because (0.5) -1 = 2 [see Eq. (8.4)]. 

A Exercise E8.1 

Sketch signals (a) (l) fc (b) (—1)* (c) (0.5) fc (d) (— 0.5) fc (e) (0.5) -fc (f) 2~ k (g) (— 2) k . 
Express these exponentials as j k , and plot 7 in the complex plane for each case. Verify that 7 * 
decays exponentially with fc if 7 lies inside the unit circle, and that 7 fc grows with fc if 7 is outside 
the unit circle. If 7 is on the unit circle, 7 fe is constant or oscillates with a constant amplitude. 

Hint: (l) fc = 1 for all fc. However, (— l) k = 1 for even values of fc and is —1 for odd values of 
fc. Therefore, ( — 1)* switches back and forth from I to —1 (oscillates with a constant amplitude). 
Note also that Eq. (8.4) yields (0.5) -te = 2 k V 


0 


1 2 3 4 5 6 * 


0 


1 2 3 4 5 6 *. 


<C> (d) 

Fig* 8.6 discrete- time exponentials y k . 


A Exercise E8.2 

(0-13$ 2Z& = (1 ^ ^ = 

(b) Show that (i) 2 k = e o.693fc , n _ 0 69 ,, ' ' 

' ' e W (0.5)' =e u ' t>93lc (iil) (0.8) _lc = e°- 2231fc y 

O Computer Example C8.1 

Sketch the discrete-time signals (a) (-0.5)* (b) (2)~* (c) (-2)* 

(a) k=0:5; k=k’; fkl=(-0.5).-k; stem(k.fk) 
b > k=0:5; k=k>; fk=2.*(-k); stem(k,fk) 

(c) k— 0:5; k— k’;fk=(-2).*k; stem(k,fk3) Q 

4. Discrete-Time Exponential e jn * 

r d r sle, - To *-’•>» -“2 

8 , 7 2 ,u “ tlon m = -'“'2 Z 

^ on 222 J" si " p “ y •“ 
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Locus of e~ jat 



Pig. 8.7 Locus of (a) e jnk (b) e~ m . 
e’ nk = re-’ 6 , r = 1, and 9 = kfl 

This fact shows that the magnitude and angle of e jT!,c are 1 and kfl, respectively. 
Therefore, the points e ■ ,0 , e jn , e j2n , e j3f! , ... , e ikQ , ... lie on a circle of unit ra- 
dius (unit circle) at angles 0, H, 2 fi, 3 fl, .... kfl, . . . respectively, as shown in Fig. 
8.7a. For each unit increase in k, the function f[k] = e’ nk moves along the 

unit circle counterclockwise by an angle fl. Therefore, the locus of e^ k may be 

viewed as a phasor rotating counterclockwise at a uniform speed of f2 radians per 
unit sample interval. The exponential e~’ nk , on the other hand, takes on values 
e 1° = 1, e~ :n , e~i 2nk , e~’ 3n , . . . at k = 0, 1, 2, 3, . . ., as depicted in Fig. 8.7b. 
Therefore, e~J nk may be viewed as a phasor rotating clockwise at a uniform speed 
of fl radians per unit sample interval. 

Using Euler’s formula, we can express an exponential e’ nk in terms of sinusoids 
of the form cos (flk + 6), and vice versa 

e’ nk _ ( cos _|_ j s j n Qfcj (8.5a) 

e -jf2fc _ ( cos qj. _ j s j n Qfc'j (8.5b) 

These equations show that the frequency of both e jSlfc and is fl (ra- 

dians/sample). Therefore, the frequency of e’ nk is |fi|. Because of Eqs. (8.5), 
exponentials and sinusoids have similar properties and peculiarities. The discrete- 
time sinusoids will be considered next. 

5. Discrete-Time Sinusoid cos (fl k + 6) 

A general discrete-time sinusoid can be expressed as C cos (f Ik + 9), where C 
is the amplitude, f2 is the frequency (in radians per sample), and 9 is the phase (in 
radians). Figure 8.8 shows a discrete-time sinusoid cos(^/o + J). 

Here we make one basic observation. Because cos(— x) = cos(x), 

cos (—fife + 9) = cos (f Ik - 9) (8.6) 

This shows that both cos (Clk + 9) and cos (-flk + 0) have the same frequency (fl). 
Therefore, the frequency of cos (fife +0) is |fi|. 
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Fig. 8.8 A discrete-time sinusoid cos(-j + J). 


Q Computer Example C8.2 

Sketch the discrete-time sinusoid cos (75^+ f ) 

k=-36:30; k=k’; 
fk=cos(k*pi/12+pi/4); 
stem(k,fk) Q 

Sampled Continuous-Time Sinusoid Yields a Discrete-Time Sinusoid 

A continuous-time sinusoid cos ut sampled every T seconds yields a discrete- 
time sequence whose fcth element (at t = kT) is cos ukT. Thus, the sampled signal 
/[fcj is given by 

/[fc] = cos u>kT 

= cos flk where ft — uT (8.7) 

Clearly, a continuous-time sinusoid cos ut sampled every T seconds yields a discrete- 
time sinusoid cos flk, where fl = uT. Superficially, it may appear that a discrete- 
time sinusoid is a continuous-time sinusoid’s cousin in a striped suit. As we shall 
see, however, some of the properties of discrete-time sinusoids are very different 
from those of continuous-time sinusoids. In the continuous-time case, the period 
of a sinusoid can take on any value; integral, fractional, or even irrational. The 
discrete-time signal, in contrast, is specified only at integral values of k. Therefore, 
the period must be an integer (in terms of k) or an integral multiple of T (in terms 
of variable t). 

Some Peculiarities of Discrete-Time Sinusoids 

There are two unexpected properties of discrete-time sinusoids which distin- 
guish them from their continuous-time relatives. 

1. A continuous-time sinusoid is always periodic regardless of the value of its 
frequency u. But a discrete-time sinusoid cos flk is periodic only if D is 27 t 
times some rational number ( ^ is a rational number). 

2. A continuous-time sinusoid cos ut has a unique waveform for each value of u. 
In contrast, a sinusoid cos flk does not have a unique waveform for each value 
of fl. In fact, discrete-time sinusoids with frequencies separated by multiples of 
2ir are identical. Thus, a sinusoid cos flk = cos (fl+2n)k = cos (fl+4n)k = - - ■. 
We now examine each of these peculiarities. 

1 Not All Discrete-Time Sinusoids Are Periodic 

A discrete-time signal f[k } is said to be Ao-periodic if 

f[k] = f[k + N 0 ] 


( 8 . 8 ) 
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for some positive integer No. The smallest value of No that satisfies Eq. (8.8) is 
the period of f[k j. Figure 8.9 shows an example of a periodic signal of period 6. 
Observe that each period contains 6 samples (or values). If we consider the first 
cycle to start at k = 0, the last sample (or value) in this cycle is at fe = JVo — 1 = 5 
(not at k = No = 6). Note also that, by definition, a periodic signal must begin at 
k = — oo (everlasting signal) for the reasons discussed in Sec. 1.2-4. 



If a signal cos Dfc is IVo-periodic, then 

cos f Ik = cos Cl(k + No) 

= cos (Clk + ClNo) 

This result is possible only if ClNo is an integral multiple of 2n-; that is, 


or 


ClNo = 2nm m integer 

H m 
2n Nq 


(8.9a) 


Because both m and No are integers, Eq. (8.9a) implies that the sinusoid cos Clk is 
periodic only if ^ is a rational number. In this case the period No is given by [Eq. 
(8.9a)] 


Nq = to 



(8.9b) 


To compute No, we must choose the smallest value of m that will make m(^J) 
an integer. For example, if fl = then the smallest value of m that will make 
an integer is 2. Therefore 


2 ir 17 

lV° = m - = 2 T = 17 


Using a similar argument, we can show that this discussion also applies to a 
discrete-time exponential e jm . Thus, a discrete-time exponential e jf2fc is periodic 
only if is a rational number. f 


Physical Explanation of the Periodicity Relationship 

Qualitatively, this result can be explained by recognizing that a discrete-time 
sinusoid cos Clk can be obtained by sampling a continuous-time sinusoid cos fit at 
unit time interval T = 1; that is, cos fit sampled at t = 0, 1, 2, 3, . . .. This fact 


(We can also demonstrate this point by observing that if e 3 ^ k is IVo-periodic, then 

e jnk _ e j?i(k+Na) _ e jnk e jQN 0 

This result is possible only if flNo = 2rr m (m, an integer). This conclusion leads to Eq. (8.9b). 
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(c) 


Fig. 8.10 Physical explanation of the periodicity relationship. 

means cos fit is the envelope of cos Clk. Since the period of cos fit is 2ir/Cl, there 
are 27t/fl number of samples (elements) of cos Clk in one cycle of its envelope. This 
number may or may not be an integer. 

Figure 8.10 shows three sinusoids cos(Jfc), cos(|yfc)i and cos(0.8fc). Figure 
8.10a shows cos(ffc), for which there are exactly 8 samples in each cycle of its 
envelope ((j^ = 8). Thus, cos(^fc) repeats every cycle of its envelope. Clearly, 
cos(4fc/rr) is periodic with period 8. On the other hand, Fig. 8.10b, which shows 
cos(yyfc), has an average of ^ = 8.5 samples (not an integral number) in one cycle 
of its envelope. Therefore, the second cycle of the envelope will not be identical 
to the first cycle. But there are 17 samples (an integral number) in 2 cycles of 
its envelope. Hence, the pattern becomes repetitive every 2 cycles of its envelope. 
Therefore, cos (ff fc) is also repetitive but its period is 17 samples (two cycles of its 
envelope). This observation indicates that a signal cos Clk is periodic only if we can 
fit an integral number (Nq) of samples in m integral number of cycles of its envelope 
so that the pattern becomes repetitive every m cycles of its envelope. Because the 
period of the envelope is we conclude that 

JV° = m(!) 

which is precisely the condition of periodicity in Eq. (8.9b). If ^ is irrational, it is 
impossible to fit an integral number (No) of samples in an integral number (m) of 
cycles of its envelope, and the pattern can never become repetitive. For instance, 
the sinusoid cos (0.8fc) in Figure 8.10c has an average of 2.5rr samples (an irrational 
number) per envelope cycle, and the pattern can never be made repetitive over any 
integral number (m) of cycles of its envelope; so cos (0.8k) is not periodic. 
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A Exercise E8.3 

State with reasons if the following sinusoids are periodic. If periodic, find the period. 

(i) cos(y-k) (ii) cos ( ^ fc) (iii) cos(^jrk) 

Ans: (i) Periodic: period No = 14. (ii) and (iii) Aperiodic: Q/2ir irrational. v 

0 Computer Example C8.3 

Sketch and verify if cos (^fc) is periodic. 

According to Eq. (8.9b), the smallest value of m that will make No = m (jf) = 
m (y) an integer is 3. Therefore, No = 14. This result means cos (y-k) is periodic and 
its period is 14 samples in three cycles of its envelop. This assertion can be verified by the 
following MAT1AB commands: 

t=-5*pi:pi/100:5*pi; t=t’j 
ft=cos(3*pi*t/7); 
plot (t, ft,’:’), hold on 
k=-15:15; k=k’; 
fk=cos(k*3*pi/7); 
stem(k,fk), hold off 0 

2 Nonuniqueness of Discrete-Time Sinusoid Waveforms 

A continuous-time sinusoid cos ut has a unique waveform for every value of u> 
in the range 0 to oo. Increasing u> results in a sinusoid of ever increasing frequency. 
Such is not the case for the discrete-time sinusoid cos tik because 

cos (SI ± 2iem)k = cos (tik ± 2itmk) 

Now, if m is an integer, mk is also an integer, and the above equation reduces to 

cos (ti ± 2irm)k = cos tik m integer (8.10) 

This result shows that a discrete-time sinusoid of frequency ti is indistinguishable 
from a sinusoid of frequency ti plus or minus an integral multiple of 27 t. This 
statement certainly does not apply to continuous-time sinusoids. 

This result means that discrete-time sinusoids of frequencies separated by in- 
tegral multiples of 2 it are identical. The most dramatic consequence of this fact is 
that a discrete-time sinusoid cos (tik + 0) has a unique waveform only for the values 
of ti over a range of 2 tt. We may select this range to be 0 to 2ir, or ir to 3?r, or even 
-ir to ir. The important thing is that the range must be of width 2ir. A sinusoid 
of any frequency outside this interval is identical to a sinusoid of frequency within 
this range of -width 2-n. We shall select this range —ir to n and call it the funda- 
mental range of frequencies. Thus, a sinusoid of any frequency 0 is identical 
to some sinusoid of frequency tif in the fundamental range — ir to ir. Consider, for 
example, sinusoids of frequencies ti = 8.7ir and 9. 671 -. We can add or subtract any 
integral multiple of 2-ir from these frequencies and the sinusoids will still remain 
unchanged. To reduce these frequencies to the fundamental range (—ir to n), we 
need to subtract 4 x 2it = 87r from 8.7-rr and subtract 5 x 2 tt = XOir from 9. 677 , to 
yield frequencies 0.77r and -0.47r, respectively. Thus 


cos (8.7nk + 9) = cos ( 0.7irk + 9) 
cos (9.67rfc + 8) = cos (-0.47rfc + 0) 


( 8 . 11 ) 
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This result shows that a sinusoid cos (tik + 9) can always be expressed as 
cos (tifk +6), where -ir < tif < n (the fundamental frequency range). The reader, 
should get used to the fact that the range of discrete- time frequencies is only 27 r. 
We may select this range to be from -tt to tt or from 0 to 2 tt, or any other interval of 
width 2ir . It is most convenient to use the range from - 7 r to tt. At times, however, 
we shall find it convenient to use the range from 0 to 2 tt. Thus, in the discrete-time 
world, frequencies can be considered to lie only in the fundamental frequency range 
(from 7 r to 7 r, for instance). Sinusoids of frequencies outside the fundamental 
frequencies do exist technically. But physically, they cannot be distinguished from 
the sinusoids of frequencies within the fundamental range. Thus, a discrete-time 
sinusoid of any frequency, no matter how high, is identical to a sinusoid of some 
frequency within the fundamental range (- 7 r to 7 r). 

The above results, derived for discrete-time sinusoids, are also applicable to 
discrete-time exponentials of the form e jnk . For example 

j(f!±2irm)k _ J(lk±j2irmk _ JQk . . 

e — e e = e J m, integer (8-12) 

Here we have used the fact that e ±j27rn = 1 for all integral values of n. This result 
means that discrete-time exponentials of frequencies separated by integral multiples 
of 2 tt are identical. 

Further Reduction in the Frequency Range of Distinguishable Discrete-Time 
Sinusoids 

We shall now show that the range of frequencies that can be distinguished can 
be further reduced from (-tt, tt) to (0, it). According to Eq. (8.6), cos (-tik + 9) - 
cos (tik — 6). In other words, the frequencies in the range (0 to -tt) can be expressed 
as frequencies in the range (0 to jr) with opposite phase. For example, the second 
sinusoid in Eq. (8.11) can be expressed as 

cos (9.67rfc + 9) = cos(-0.4t rk + 9) = cos (QAirk - 9) (8.13) 

This result shows that a sinusoid of any frequency ti can always be expressed as a 
sinusoid of a frequency 10/1, where |0/| lies in the range 0 to tt. Note, however, a 
possible sign change in the phases of the two sinusoids. In other words, a discrete- 
time sinusoid of any frequency, no matter how high, is identical in every respect to 
a sinusoid within the fundamental frequency range, such as -ir to ir. In contrast, a 
discrete-time sinusoid of any frequency, no matter how high, can be expressed, with 
a possible sign change in phase, as a sinusoid of frequency in the range (0, 7 r); that 
is, within half the fundamental frequency range. 

A systematic procedure to reduce the frequency of a sinusoid cos (tik + 9) is to 
express fi asf 

12 = 12/ + 2irm |H/| < 7r, and m an integer (8.14) 

This procedure is always possible. The reduced frequency of the sinusoid cos (tik+9) 
is then |S1/|. 

t Equation (8.14) can also be expressed as Q/ = ^l mo dulo 2 * 
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B Example 8.1 

Consider sinusoids of frequencies fi equal to (a)0.57r (b) 1.6 tt (c) 2.5ir (d) 5.6ir (e) 
34.116. Each of these sinusoids is equivalent to a sinusoid of some frequency |fi/| in the 
range 0 to 7r. We shall now determine these frequencies. This goal is readily accomplished 
by expressing the frequency fi as in Eq. (8.14). 

(a) The frequency 0.57T is in the range (0 to tt) so that it cannot be reduced further. 

(b) The frequency 1.6 tt = 2tt - 0.4jt, and fi/ = -0.4 tt. Therefore, a sinusoid of 
frequency 1.6tr can be expressed as a sinusoid of frequency |fi/| = 0.47T. 

(c) 2.5rr = 2r + 0.57T, and 12/ = 0.57T. Therefore, a sinusoid of frequency 2.57T can be 
expressed as a sinusoid of frequency |f2/| = 0.57T. 

(d) 5.6 tt = 3(27r ) — 0.47T, and 0/ = — 0.47r. Therefore, a sinusoid of frequency 5.67T 
can be expressed as a sinusoid of frequency |fi/| = 0.47T. 

(e) 34.116 = 5(27 t) + 2.7, and fi / -- 2.7. Therefore, a sinusoid of frequency 34.116 
can be expressed as a sinusoid of frequency |fi/| = 2.7. I 

The fundamental range frequencies can be determined by using a simple graphi- 
cal artifice as follows: mark all the frequencies on a tape using a linear scale, starting 
with zero frequency. Now wind this tape continuously around the two poles, one 
at |fi/| = 0 and the other at |fi/| = 7r, as illustrated in Fig. 8.11. The reduced 
value of any frequency marked on the tape is its projection on the horizontal (|fi/j) 
axis. For instance, the reduced frequency corresponding to fi = 1.6rr is 0.4?r (the 
projection of 1.6tt on the horizontal fi/ axis). Similarly, frequencies 2.5ir, 5.6rr, and 
34.116 correspond to frequencies 0.5 tt, 0.4tt, and 2.7 on the |fi/| axis. 

A Exercise 138.4 

Show that the sinusoids of frequencies fi = (a) 2 jt (b)3ir (c)5jt (d)3.2tr (e) 22.1327 (f)ir-<-2 
can be expressed as sinusoids of frequencies (a) 0 (b) ir (c) tr (d) 0.8 tt (e) 3 (f) jr - 2 , respectively. 
V. 

A Exercise E8.5 

Show that a discrete-time sinusoid of frequency tr -f- x can be expressed as a sinusoid with 
frequency ir — x (0 < x < it). This fact shows that a sinusoid with frequency above tr by amount 
x has the frequency identical to a sinusoid of frequency below rr by the same amount x, and the 
maximum rate of oscillation occurs at fi — n. As fi increases beyond 7r, the rate of osciiiation 
actually decreases. V- 

Q Computer Example C8.4 

In the fundamental range of frequencies from -7r to 7r find a sinusoid that is indis- 
tinguishable from the sinusoid cos (y~kj. Verify by plotting these two sinusoids that they 
are indeed identical. 

The sinusoid cos (- 'fk'j is identical to the sinusoid cos - 27r) k = cos (-liifc) = 
cos ( li 1 fc) . We may verify that these two sinusoids are identical. 

k=-15:15; k=k’; 

fkl=cos(3*pi*k/7); 

fk2=cos( ll*pi*k/7); 

stem(k,fkl,’x’),hold on, 

stem(k,fk2),hold off Q 


Physical Explanation of Nonuniqueness of Discrete-Time Sinusoids 

Nonuniqueness of discrete-time sinusoids is easy to prove mathematically. But 
why does it happen physically? We now give here two different physical explanations 
of this intriguing phenomenon. 


A ’ ' I 
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Fig. 8.12 Physical explanation of nonuniqueness of Discrete-time sinusoid waveforms. 
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Human Eye is a Lowpass Filter 

Figure 8.12 also brings out one interesting fact; that a human eye is a lowpass 
filter. Both the continuous-time sinusoids in Fig. 8.12 have the same set of sam- 
ples. Yet, when we see the samples, we interpret them as the samples of the lower 
frequency sinusoid. The eye does not see (or cannot reconstruct) the wiggles of the 
higher frequency sinusoid between samples because the eye is basically a lowpass 
filter. 



Fig. 8.13 Another physical explanation of nonuniqueness of discrete-time sinusoid wave- 
forms. 


The Second Explanation 

Here we shall present a quantitative argument using a discrete-time exponential 
rather than a discrete-time sinusoid. As explained earlier, a discrete-time exponen- 
tial e^ nk can be viewed as a phasor rotating counterclockwise at a uniform angular 
velocity of 0 rad/sample, as shown in Fig. 8.7a. A similar argument shows that the 
exponential e~ jnk is a phasor rotating clockwise at a uniform angular velocity of 
U radians per sample, as depicted in Fig. 8.7b. The angular velocity of both these 
rotating phasors is Q rad. Therefore, as the frequency increases, the angular ve- 
locity also increases. This, however, is true only for values of f 1 in the range 0 to ir. 
Something very interesting happens when the frequency f 1 increases beyond it. Let 
n = ir + x where x < it. Figure 8.13a shows the phasor progressing from k = 0 to 
k = 1, and Fig. 8,13b shows the same phasor progressing from k = 1 to k — 2. Be- 
cause the phasor rotates at a speed of fi = it + x radians/sample, the phasor angles 
at k = 0, 1, and 2 are 0, it + x and 2tt + 2x = lx, respectively. In both the figures, 
the phasor is progressing counterclockwise at a velocity of (it + x) rad/sample. But 
we may also interpret this motion as the phasor moving clockwise (shown in gray) 
at a lower speed of (ir - x ) rad/sample. Either of these interpretations describes 
the phasor motion correctly. If this motion could be seen by a human eye, which 
is a lowpass filter, it will automatically interpret the speed as ir - x, the lower of 
the two speeds. This is the stroboscopic effect observed in movies, where at certain 
speeds, carriage wheels appear to move backwards.) 

) A stroboscope is a source of light that flashes periodically on an object, thus generating a sampled 
image of that object. When a stroboscope flashes on a rotating object, such as a wheel, the wheel 
appears to rotate at a certain speed. Now increase the actual speed of rotation (while maintaining 
the same flashing rate). If the speed is increased beyond some critical value, the wheels appear 
to rotate backwards because of the lowpass filtering effect described above in the text. As we 
continue to increase the speed further, the backward rotation appears to slow down continuously 
to zero speed (where the wheels appear stationary), and reverse the direction again. This effect is 
often observed in movies in scenes with running carriages. A movie reel consists of a sequence of 
photographs shot at discrete instants, and is basically a sampled signal. 
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Thus, in a signal the frequency H = ir + x appears as frequency n — x. 
Therefore, as Q increases beyond tr, the actual frequency decreases, until at fl = 27r 
(x = jt), the actual frequency is zero (it - x = 0). As we increase Q beyond 2ir, the 
same cycle of events repeats. For instance, fl = 2.5i r is the same as 0 = 0.5ir. 



Fig. 8.14 Highest Oscillation Kate in a Discrete-Time sinusoid occurs at Q = ir. 


Highest Oscillation Rate in a Discrete-Time Sinusoid Occurs at fl = 7 r 

This discussion shows that the highest rate of oscillation occurs for the fre- 
quency fi = ir . The rate of oscillation increases continuously as H increases from 
0 to Tr , then decreases as Q increases from 7 r to 2 it. Recall that a frequency tt + x 
appears as the frequency ir - x. The frequency Q = 2ir (x = it) is the same as the 
frequency Q = 0 (constant signal). These conclusions can be verified from Fig. 8.14, 
which shows sinusoids of frequencies D = (a) 0 or 2ir (b) | or (c) J or —■ (d) ir. 

6. Exponentially Varying Discrete-Time Sinusoid y k cos (Qk + 6) 

This is a sinusoid cos (O. k+8) with an exponentially varying amplitude j k . It is 
obtained by multiplying the sinusoid cos (Uk + 6) by an exponential j k . Figure 8.15 



Fig. 8.15 Examples of exponentially varying discrete-time sinusoids. 


shows signals (0.9)* cos (f k - f), and (1.1)* cos (£ k - §). Observe that if | 7 | < 1, 
the amplitude decays, and if | 7 | > 1, the amplitude grows exponentially. 

8.2-1 Size of a Discrete-Time Signal 

Arguing along the lines similar to those used in continuous-time signals, the 
size of a discrete-time signal f[k] will be measured by its energy Ef defined by 

OO 

E f= E i/mi 2 ( 8 - 15 ) 

k=~ oo 

This definition is valid for real or complex f[k]. For this measure to be meaningful, 
the energy of a signal must be finite. A necessary condition for the energy to be 
finite is that the signal amplitude must — * 0 as |fc| — * oo. Otherwise the sum in Eq. 
(8.15) will not converge. If Ef is finite, the signal is called an energy signal. 

In some cases, for instance, when the amplitude of f[k] does not -> 0 as |fc| -* 
oo, then the signal energy is infinite, and a more meaningful measure of the signal 
in such a case would be the time average of the energy (if it exists), which is the 
signal power Pf defined by 

p f = K 1 ™ WTl E l/WI 2 (8-16) 

-N 

For periodic signals, the time averaging need be performed only over one period in 
view of the periodic repetition of the signal. If P f is finite and nonzero, the signal is 
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called a power signal. As in the continuous-time case, a discrete-time signal can 
either be an energy signal or a power signal, but cannot be both at the same time. 
Some signals are neither energy nor power signals. 

A Exercise E8.7 

(a) Show that the signal a k u[k] is an energy signal of energy t _j- 3 if | a | < 1. It is a power 
signal of power Pf = 0.5 if |o| = 1. It is neither an energy signal nor a power signal if |o| >1. v 

8.3 Sampling Continuous-Time Sinusoid and Aliasing 

On the surface, the fact that discrete-time sinusoids of frequencies differing by 
2nm are identical may appear innocuous. But in reality it creates a serious problem 
for processing continuous-time signals by digital filters. A continuous-time sinusoid 
f(t) = cos uit sampled every T seconds ( t = kT) results in a discrete-time sinusoid 
/[*1 = cos uikT . Thus, the sampled signal f[k] is given by 

f[k\ = cos ukT 

= cos f ! k where fi — uT 

Recall that the discrete-time sinusoids cos f ~lk have unique waveforms only for the 
values of frequencies in the range Q < n or ojT < n (fundamental frequency range). 
We know that a sinusoid of frequency f2 > 7i appears as a sinusoid of a lower 
frequency Ct < n. For a sampled continuous-time sinusoid, this fact means that 
samples of a sinusoid of frequency u > n/T appear as samples of a sinusoid of 
lower frequency u < n/T. The mechanism of how the samples of continuous-time 
sinusoids of two (or more) different frequencies can generate the same discrete- 
time signal is shown in Fig. 8.12. This phenomenon is known as aliasing because, 
through sampling, two entirely different analog sinusoids take on the same “discrete- 
time” identity. 

Aliasing causes ambiguity in digital signal processing, which makes it impos- 
sible to determine the true frequency of the sampled signal. Therefore, aliasing 
is highly undesirable and should be avoided. To avoid aliasing, the frequencies 
of the continuous-time sinusoids to be processed should be kept within the range 
wT < it or w < n/T. Under this condition, the question of ambiguity or aliasing 
does not arise because any continuous-time sinusoid of frequency in this range has 
a unique waveform when it is sampled. Therefore, if u h is the highest frequency to 
be processed, then, to avoid aliasing, 

(8.17a) 

If ^ is the highest frequency in Hertz, T h = w h /2n, and, according to Eq. (8.17a), 

^ 1 

?h < -x= (8.17b) 

or 

T - (8.17c) 

This result shows that discrete-time signal processing places the limit on the highest 
frequency that can be processed for a given value of the sampling interval T 
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according to Eq. (8.17b). But we can process a signal of any frequency (without 
aliasing) by choosing a sufficiently low value of T according to Eq. (8.17c). The 
sampling rate or sampling frequency F s is the reciprocal of the sampling interval 
T, and, according to Eq. (8.17c),f 

^ ^ > 2 F h (8.18) 

This result, which is a special case of the sampling theorem (proved in Chapter 
5), states that to process a continuous-time sinusoid by a discrete-time system, the 
sampling rate must not be less than twice the frequency (in Hz) of the sinusoid. In 
short, a sampled sinusoid must have a minimum of two samples per cycle. 
For a sampling rate below this minimum value, the output signal will be aliased, 
which means the signal will be mistaken for a sinusoid of lower frequency. 

Equation 8.18 indicates that Fh, the highest frequency that can be processed, 
is half the sampling frequency F a . This means the range of frequencies that can be 
processed without aliasing is from 0 to F s /2 

0<^<y (8.19) 

Frequencies greater than F a /2 (half the sampling frequency) will be aliased and 
appear as frequencies lower than F s /2. The aliasing appears as a folding back 
of frequencies about F ,/2. Hence, this frequency is also known as the folding 
frequency. The details of this folding are explained more fully in Fig. 5.6. 

The folding process is multilayered, as depicted in Fig. 8.11. The spectrum 
first folds back at the folding frequency, and then again folds forward at the origin, 
then back again at the folding frequency, and so on. We can find the aliased 
frequency (the reduced frequency) using an equation similar to Eq. (8.14) applicable 
to sampled continuous-time sinusoids. 

We saw that a continuous-time sinusoid of frequency uj appears as a discrete- 
time sinusoid of frequency Cl ~ wT . Hence, if uj j is the reduced (aliased) frequency 
corresponding to a sinusoid of frequency u>, then, according to Eq. (8.14) 

uT = ufT + 2ir m |w/|T < tt, and m an integer (8.20) 

When we express the radian frequencies in Hertz (uj = 2irF , etc.), and use the fact 
that the sampling frequency F s = Eq. (8.20) becomes 

F = Ff + mF s \Ff\ < -F-, and m an integer (8-21) 

Thus, if a continuous-time sinusoid of frequency F Hz is sampled at a rate of F s 
Hz (samples/second), the resulting samples would appear as if they had come from 
a continuous-time sinusoid of a lower (aliased) frequency For instance, if 

a continuous-time sinusoid of frequency 10 kHz were sampled at a rate of 3 kHz 
(3000 samples/second), the resulting samples will appear as if they had come from 
a continuous-time sinusoid of frequency 1 kHz because 10,000 = 1,000 + 3(3000). 
Note, however, if the frequency of a sinusoid is less than the folding frequency F s j2 
(half the sampling frequency), there is no aliasing. Thus, the condition for the 
absence of aliasing is that the frequency of a sinusoid must be less than half the 
sampling frequency (the folding frequency). 

fin some special cases, where the signal spectrum contains an impulse at Ft,, the sampling rate 
F a must be greater than 2Fh (see footnote on p.321) 
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H Example 8.2 

Determine the maximum sampling interval T that can be used in a discrete-time, 
oscillator which generates a sinusoid of 50 kHz. 

Here the highest frequency F h = 50 kHz. Therefore, according to Eq. (8.17c) 

T -2k = 10/iS 

The sampling interval must not be greater than 10 /zs. The minimum sampling frequency 
* s Fa ~ T ~ 100 kHz. If we use T = 10 ps, the oscillator output will exhibit two samples 
per cycle. If we require the oscillator output to have 20 samples per cycle, then we must 
use T = lps (sampling frequency F, = 1 MHz). ■ 

I Example 8.3 

A discrete-time amplifier uses a sampling interval T - 25 ps. What is the highest 
frequency of a signal that can be processed with this amplifier without aliasing? 

According to Eq. (8.17b) 

•ft. = 2 ? = 20 kHz ■ 

I Example 8.4 

A sampler with sampling interval T = 0.001 second (1 ms.) samples continuous-time 
sinusoids of the following frequencies: (a) 400 Hz (b) 1 kHz (c) 1.4 kHz (d) 1.6kHz (e) 
3.522 kHz. Determine the aliased frequencies of the resulting sampled signals. 

The sampling frequency is F, = 1/T = 1,000. The folding frequency F,/2 = 500. 
Hence, sinusoids below 500 Hz will not be aliased and sinusoids of frequency above 500 Hz 
will be aliased. Using Eq. (8.21), we find: 

(a) 400 Hz is less than 500 Hz (the folding frequency, which is half the sampling 
frequency F s ). Hence, there is no aliasing. 

(b) 1000 = 0 + 1000 so that Fj = 0 and the aliased frequency (|.F/|) is zero. The 
sampled signal appears as samples of a dc signal. 

(c) 1400 = 400 + 1000 so that Fj - 400 and the aliased frequency (\Ff\) is 400 Hz. 
The sampled signal appears as samples of a signal of frequency 400 Hz. 

(d) 1600 = -400 + 2(1000) so that F/ = -400 and the aliased frequency (\F/\) is 400 
Hz. The sampled signal appears as samples of a signal of frequency 400 Hz. 

(e) 3522 = —478 + 4(1000) so that Fj — —478 and the aliased frequency (\Fj\) is 478 
Hz. The sampled signal appears as samples of a signal of frequency 478 Hz. 

Graphically, we can solve this problem using the artifice in Fig. 8.11. The folding 
frequency is 500 Hz instead of n. In case (a), the frequency 400 Hz is below the folding 
frequency 500 Hz. Hence, the samples of this sinusoid will not be aliased. For case (b), the 
frequency 1000 Hz, when folded back at 500 Hz terminates at the origin F = 0. Hence, 
the aliased frequency is 0. For case (c), the frequency 1400 Hz folds back at 500 Hz, then 
folds forward at 0, and terminates at 400 Hz. Similarly, for case (d), the frequency 1600 
Hz folds back at 500, then folds forward at 0, and folds back again at 500 Hz to terminate 
at 400 Hz, and so on. I 

8.4 Useful Signal Operations 

Signal operations discussed for continuous-time systems also apply to discrete- 
time systems with some modification in time scaling. Since the independent variable 
in our signal description is time, the operations are called time shifting, time in- 
version (or time reversal), and time scaling. However, this discussion is valid for 
functions having independent variables other than time (e.g., frequency or distance). 
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Fig. 8.16 Time-shifting and time inversion of a signal. 


8.4- 1 Time Shifting 

Following the argument used for continuous-time signals, we can show that 
to time shift a signal /[fc] by m units, we replace k with k - m. Thus, f[k - m\ 
represents / [fc] time shifted by m units. If m is positive; the shift is to the right 
(delay). If m is negative, the shift is to the left (advance). Thus, f[k - 2] is f\k) 
delayed (right-shifted) by 2 units, and f[k + 2] is f[k] advanced (left-shifted) by 

2 units. The signal fd[k] in Fig. 8.16b, being the signal in Fig. 8.16a delayed by 
5 units, is the same as f[k\ with k replaced by k — 5. Now, f[k] = (0.9) fc for 

3 < k < 10. Therefore, fd[k] = (0.9) fc ~ 5 for 3 < k - 5 < 10 or 8 < k < 15, as 
illustrated in Fig. 8.16b. 

8.4- 2 Time Inversion (or Reversal) 

Following the argument used for continuous-time signals, we can show that 
to time invert a signal f[k], we replace k with —k. This operation rotates the 
signal about the vertical axis. Figure 8.16c shows f r [k], which is the time-inverted 
signal / [fc] in Fig. 8.16a. The expression for f r [k] is the same as that for f[k ] with 
k replaced by —k. Because f[k] = (0.9) fc for 3 < k < 10, / r (fc] = (0.9) -A: for 
3 < -fc < 10; that is, -3 > fc > -10 , as shown in Fig. 8.16c. 


8.4 Useful Signal Operations 

8.4-3 Time Scaling 

Following the argument used for continuous-time signals, we can show that to 
time scale a signal f[k] by a factor a, we replace k with ak. However, because 
the discrete-time argument k can take only integral values, certain restrictions and 
changes in the procedure are necessary. 


Time Compression: Decimation or Downsampling 

Consider a signal 

h[k] = /[2k] (8.22) 

The signal f c [k ] is the signal /[fc] compressed by a factor 2. Observe that / c [0] = 
/ [0] , / c [l] = /[ 2], f c [ 2] = / [4] , and so on. This fact shows that / c [fc] is made 
up of even numbered samples of /[fc]. The odd numbered samples of /[fc] are 
missing (Fig. 8.17b).f This operation loses part of the data, and that is why such 
time compression is called decimation or downsampling. In the continuous-time 
case, time compression merely speeds up the signal without loss of data. In general, 
/[mfc] (m integer) consists of only every mth sample of /[fc]. 


Time Expansion 


Consider a signal 


fe[k] = / 


(8.23) 


The signal / e [fc] is the signal /[fc] expanded by a factor 2. According to Eq. (8.23), 
/«[0] = m, fe{ 1] = / [1/2] , /,[ 2] = /[ 1], /e[3] = /[3/2], /,[ 4] = /[ 2], f e [ 5] = 
/ [5/2] , / e [6] = / [3] , and so on. Now, /[fc] is defined only for integral values of 
fc, and is zero (or undefined) for all fractional values of fc. Therefore, for / e [fcj, its 
odd numbered samples / e [l], / c [3] , / e [5], . . . are all zero (or undefined), as depicted 
in Fig. 8.17c. In general, a function / e [fc] = f[k/m\ ( m integer) is defined for 
fc = 0, ±m, ±2m, ±3m, . . ., and is zero (or undefined) for all remaining values of 
fc. 


Interpolation 

In the time-expanded signal in fig. 8.17c, the missing odd numbered samples can 
be reconstructed from the nonzero valued samples using some suitable interpolation 
formula. Figure 8.17d shows such an interpolated function /* [fc] , where the missing 
samples are constructed using an ideal lowpass filter interpolation formula (5.10b). 
In practice, we may use a realizable interpolation, such as a linear interpolation, 
where /;[1] is taken as the mean of /j[0] and fi[2]. Similarly, /j[3] is taken as the 
mean of fi[ 2] and /;[4], and so on. This process of time expansion and inserting the 
missing samples using an interpolation is called interpolation or upsampling. In 
this operation, we increase the number of samples. 

A Exercise E8.6 

Show that for a linearly interpolated function /,[fc] = /[fc/2], the odd numbered samples 
interpolated values are /j[fc] = A {/[^yM + /I^']}- V 


fOdd numbered samples of /[fc] can be retained (and even numbered samples omitted) by using 
the transform 

f c [k] = /[2fc + 1] 






[ 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 

Fig. 8.17 Time compression (decimation) and time expansion (interpolation) of a signal. 


8-5 Examples of Discrete-Time Systems 

We shall give here three examples of discrete-time systems. In the first two ex- 
amples, the signals are inherently discrete-time. In the third example, a continuous- 
time signal is processed by a discrete-time system, as illustrated in Fig. 8.2 by 
discretizing the signal through sampling. 

H Example 8.5 

m\ P Tu 0n i_ makeS 3 deposit ( the in P ut ) in a bank regularly at an interval of T (say, 1 
month). 1 he bank pays a certain interest on the account balance during the period T and 
mails out a periodic statement of the account balance (the output) to the depositor. Find 
the equation relating the output y[fc] (the balance) to the input }[k) (the deposit). 
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In this case, the signals are inherently discrete- time. Let 

/[fc] =the deposit made at the kth discrete instant 
V M = the account balance at the fcth instant computed 
immediately after the /nth deposit f[k] is received 
r = interest per dollar per period T 

The balance y[fc] is the sum of (i) the previous balance y[k - 1], (ii) the interest on y\k - 1] 
during the period T, and (iii) the deposit f[k } 

y[fc] =y[k - 1] + ry[k - 1] + }[k\ 

=(l+r)y(fc-l] + /[fc] ( 8 . 24 ) 

or 

y[k\ - ay[fc - 1] = /(*] a = I + r (8.25a) 

In this example the deposit f[k\ is the input (cause) and the balance y[k\ is the output 
(effect). 

We can express Eq. (8.25a) in an alternate form. The choice of index k in Eq. (8.25a) 
is completely arbitrary, so we can substitute k + 1 for k to obtain 

y[k + 1) - ay[k] = f[k + 1) (8.25b) 

We also could have obtained Eq. (8.25b) directly by realizing that y[k + I], the balance at 
the (k + l)st instant, is the sum of y[k] plus ry[fc] (the interest ony[fc]) plus the deposit 
(input) f[k + 1] at the (fc + l)st instant. 

For a hardware realization of such a system, we rewrite Eq. (8.25a) as 

y[k\ = ay[k - 1) + /[k] (8 ,25c) 

Figure 8.18 shows the hardware realization of this equation using a single time delay of T 
units.f To understand this realization, assume that y[k] is available. Delaying it by T, we 
generate y[k - 1], Next, we generate y[k] from f[k ) and y\k - 1] according to Eq. (8.25c). 

yW 


Fig. 8.18 Realization of the savings account system. 

A withdrawal is a negative deposit. Therefore, this formulation can handle deposits 
as well as withdrawals. It also applies to a loan payment problem with the initial value 
^ ' w b ere M is the amount of the loan. A loan is an initial deposit with a negative 
value. Alternately, we may treat a loan of M dollars taken at k = 0 as an input of -M at 
k = 0 [see Prob. 9.4-9]. I 

(The time delay in Fig. 8.18 need not be T. The use of any other value will result in a time-scaled 
output. 
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Fig. 8.19 Realization of a second-order discrete-time system in Example 8.6. 

■ Example 8.6 

In the fcth semester, /[fc] number of students enroll in a course requiring a certain 
textbook. The publisher sells y[fc] new copies of the book in the fcth semester. On the 
average, one quarter of students with books in saleable condition resell their books at the 
end of the semester, and the book life is three semesters. Write the equation relating y[fc], 
the new books sold by the publisher, to f[k], the number of students enrolled in the fcth 
semester, assuming that every student buys a book. 

In the fcth semester, the total books f[k] sold to students must be equal to y[fc] (new 
books from the publisher) plus used books from students enrolled in the two previous 
semesters (because the book life is only three semesters). There are y[k - 1] new books 
sold in the (k - l)st semester, and one quarter of these books; that is, \y[k - 1] will be 
resold in the fcth semester. Also, y[k - 2] new books are sold in the (k - 2)nd semester, 
and one quarter of these; that is, |y[fc — 2] will be resold in the (k — l)st semester. Again 
a quarter of these; that is, ^y[fc - 2] will be resold in the fcth semester. Therefore, /[fcj 
must be equal to the sum of y[k], ±y[fc - 1], and Ty[fc _ 2], 

V[ fc ] + 3^1* - !] + - 2 ] = f\ k \ (8.26a) 

Equation (8.26a) can also be expressed in an alternative form by realizing that this equation 
is valid for any value of fc. Therefore, replacing fc by fc + 2, we obtain 

y[fc + 2] + \y\k + 1] + iy[fc] = /[fc + 2] (8.26b) 

This is the alternative form of Eq. (8.26a). 

For a realization of a system with this input-output equation, we rewrite Eq. (8.26a) 
as 

vl k \ = - \y[k - 1] - -ky[k - 2] + /[fc] (8.26c) 

Figure 8.19 shows a hardware realization of Eq. (8.26c) using two time delays (here the 
time delay T is a semester). To understand this realization, assume that y[fc] is available. 
Then, by delaying it successively, we generate y[fc - 1] and y[fc - 2], Next we generate y[fc] 
from /[fc], y[fc — 1], and y[fc — 2] according to Eq. (8.26c). H 





■ Example 8.7: Digital Differentiator 

Design a discrete-time system, like the one in Fig. 8.2, to differentiate continuous-time 
signals. Determine the sampling interval if this differentiator is used in an audio system 
where the input signal bandwidth is below 20 kHz. 

In this case, the output y(t) is required to be the derivative of the input f(t). The 
discrete-time processor (system) G processes the samples of f(t) to produce the discrete- 
time output y[k\. Let /[fc] and y[fc] represent the samples T seconds apart of the signals 
/(£) and y(t ), respectively; that is, 

f[k) = f(kT) and y(fc] — y(fcT) (8.27) 

The signals /[fc] and y[k] are the input and the output for the discrete- time system G. 
Now, we require that 

y(t) = | (8.28) 

Therefore, at t = kT (see Fig. 8.20a) 


Equations (8.25) and (8.26) are examples of difference equations; the former is a 
first-order and the latter is a second-order difference equation. Difference equations 
also arise in numerical solution of differential equations. 


y(fcT) = 


dj_ 

dt t=kT 


= lim il/ffcT)-/^- 1 ^]] 
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By using the notation in Eq. (8.27), the above equation can be expressed as 

y( fc l = f {/W - f[k - 1]} 

This is the input-output relationship for G required to achieve our objective. In practice 
the sampling interval T cannot be zero. Assuming T to be sufficiently small, the above 
equation can be expressed as 

»[ fc ] - f {/M - f[k - 1]} (8.29) 

The approximation improves as T approaches 0. A discrete-time processor G to realize 
Eq. (8.29) is shown inside the shaded box in Fig. 8.20b. The system in Fig. 8.20b acts as 
a differentiator. This example shows how a continuous-time signal can be processed by a 
discrete-time system. 

To determine the sampling interval T, we note that the highest frequency that will 
appear at the input is 20 kHz; that is, T h = 20,000. Hence, according to Eq. (8.17c) 




/[^] — f(t) \t=kT “ ^\t-kT t > 0 
= kT k > 0 

Figure 8.20d shows the sampled signal /[fc]. This signal acts as an input to the discrete- 
time system G. Figure 8.20b shows that the operation of G consists of subtracting a 
sample from the previous (delayed) sample and then multiplying the difference with 1 /T. 
R-om Fig. 8.20d, it is clear that the difference between the successive samples is a constant 
kT — (k - 1)T = T for all samples, except for the sample at k = 0 (because there is no 
previous sample at k = 0). The output of G is \/T times the difference T, which is unity 
for all values of k, except fc = 0, where it is zero. Therefore, the output of G consists 
of samples of unit values for k > 1, as illustrated in Fig. 8.20e. The D/C (discrete-time 
to continuous-time) converter converts these samples into a continuous-time signed y{t), 
as shown in Fig. 8.20f. Ideally, the output should have been y(t) = u(t). This deviation 
from the ideal is caused by the fact that we have used a nonzero sampling interval T. As 
T approaches zero, the output y(t) approaches the desired output u(t). I 
A Exercise E8.8 

Design a discrete-time system, such as in Fig. 8.2, to integrate continuous-time signals. 

Hint: If /(t) and y(t) are the input and the output of an integrator, then ^ = f(t). Approx- 
imation (similar to that in Example 8.7) of this equation at t = kT yields y[fc] - y[k - 1] = Tf\k). 
Show a realization of this system. v 

Practical Realization of Discrete-Time Systems 

These examples show that the basic elements required in the realization of 
discrete-time systems are time delays, scalar multipliers, and adders (summers). 


T < - 25 us 

- 40,000 p 

To gain some insight into this method of signal processing, let us consider the differ- 
entiator in Fig. 8.20b with a ramp input f(t) = t, depicted in Fig. 8.20c. If the system 
were to act as a differentiator, then the output y(t) of the system should be the unit step 
function u(t). Let us investigate how the system performs this particular operation and 
how well it achieves the objective. 

The samples of the input /(f) = t at the interval of T seconds act as the input to 
the discrete-time system G. These samples, denoted by a compact notation f[k], are, 
therefore, 
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We show in Chapter 11 that this is generally true of discrete-time systems. The 
discrete-time systems can be realized in two ways: 

1. By using digital computers which readily perform the operations of adding, 
multiplying, and delaying. Minicomputers and microprocessors are well suited 
for this purpose, especially for signals with frequencies below 100 kHz. 

2. By using special-purpose time-delay devices that have been developed in the 
last two decades. These include monolithic MOS charge-transfer devices (CTD) 
such as charge-coupled devices (CCD) and bucket brigade devices (BBD), 
which are implemented on silicon substrate as integrated circuit elements. In 
addition, there are surface acoustic wave (SAW) devices built on piezoelectric 
substrates. Systems using these devices are less expensive but are not as reli- 
able or as accurate as the digital systems. Digital systems are preferable for 
signals below 100 kHz. Systems using CTD are suitable and competitive with 
those using SAW devices in the frequency range 1 kHz to 20 MHz. At frequen- 
cies higher than 20 MHz, SAW devices are preferred and are the only realistic 
choice for frequencies higher than 50 MHz. Systems using SAW devices with 
frequencies in the range of 10 MHz to 1 GHz are implemented routinely. 1 

There is a basic difference between continuous-time systems and analog sys- 
tems. The same is true of discrete-time and digital systems. This is fully explained 
in Secs. 1.7-6 and 1.7-7.f For historical reasons, digital computers (rather than time- 
delay elements, such as CCD or SAW devices) were used in the realization of early 
discrete-time systems. Because of this fact, the terms digital filters and discrete- 
time systems are used synonymously in the literature. This distinction is irrelevant 
in the analysis of discrete-time systems. For this reason, in this book, the term dig- 
ital filters implies discrete-time systems, and analog filters means continuous-time 
systems. Moreover, the terms C/D (continuous-to-discrete-time ) and D/C will be 
used interchangeably with terms A/D (analog-to-digital) and D/A, respectively. 

Advantages of Digital Signal Processing 

1. Digital filters have a greater degree of precision and stability. They can be 
perfectly duplicated without having to worry about component value tolerances 
as in analog case. 

2. Digital filters are more flexible. Their characteristics can be easily altered 
simply by changing the program. 

3. A greater variety of filters can be realized by digital systems. 

4. Very low frequency filters, if realized by continuous-time systems, require pro- 
hibitively bulky components. Such is not the case with digital filters. 

5. Digital signals can be stored easily on magnetic tapes or disks without deteri- 
oration of signal quality. 

6. More sophisticated signal processing algorithms can be used to process digital 
signals. 

7. Digital filters can be time shared, and therefore can serve a number of inputs 
simultaneously. 

(The terms discrete-time and continuous-time qualify the nature of a signal along the time axis 
(horizontal axis). The terms analog and digital , in contrast, qualify the nature of the signal 
amplitude (vertical axis). 
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8 . Using integrated circuit technology, they can be fabricated in small packages 
requiring low power consumption. 

Some more advantages of using digital signals are listed in Sec. 5.1-3. 


8.6 Summary 

Signals specified only at discrete instants such as t = 0, T, 2T, 3 T, . . . , kT are 
discrete-time signals. Basically, it is a sequence of numbers. Such a signal may be 
viewed as a function of time t, where the signal is defined or specified only at t = kT 
with k any positive or negative integer. The signal therefore may be denoted as 
f{kT). Alternately, such a signal may be viewed as a function of k, where k is any 
positive or negative integer. The latter approach results in a more compact notation 
such as f[k], which is convenient and easier to manipulate. A system whose inputs 
amd outputs are discrete-time signals is a discrete-time system. 

In the study of continuous-time systems, exponentials with the natural base; 
that is, exponentials of the form e xt , where A is complex in general, are more natural 
amd convenient. In contrast, in the study of discrete-time systems, exponentials with 
a general base; that is, exponentials of the form 7 *, where 7 is complex in general, 
are more convenient. One form of exponential can be readily converted to the other 
form by noting that e xk = y k , where 7 = e A , or A = In 7 , and A as well as 7 
are complex in general. The exponential 7 * grows exponentially with k if |y | > 1 
(7 outside the unit circle), and decays exponentially if | 7 | < 1 (7 within the unit 
circle). If I 7 I = 1; that is, if 7 lies on the unit circle, the exponential is either a 
constant or oscillates with a constant amplitude. 

Discrete-time sinusoids have two properties not shared by their continuous- 
time cousins. First, a discrete-time sinusoid cos Uk is periodic only if fl/2zr is 
a rational number. Second, discrete-time sinusoids whose frequencies Q differ by 
an integral multiple of 2zr are identical. Consequently, a discrete-time sinusoid of 
any frequency f! is identical to some discrete-time sinusoid whose frequency lies in 
the interval — zr to zr (called the fundamental frequency range). Further, because 
cos (-Qk + ff) = cos ( Clk-0 ), a sinusoid of a frequency in the range from -zr to 0 can 
be expressed as a sinusoid of frequency in the range 0 to zr. Thus, a discrete-time 
sinusoid of any frequency can be expressed as a sinusoid of frequency in the range 0 
to zr . Thus, in practice, a discrete- time sinusoid frequency is at most zr. The highest 
rate of oscillation in a discrete-time sinusoid occurs when its frequency is zr. In a 
given time, a sinusoid of frequency other than zr will have a fewer number of cycles 
(or oscillations) than the sinusoid of frequency zr. This peculiarity of nonuniqueness 
of waveforms in discrete-time sinusoids of different frequencies has a far reaching 
consequences in signal processing by discrete-time systems. 

One useful measure of the size of a discrete-time signal is its energy defined by 
the sum |/[fc]| 2 , if it is finite. If the signal energy is infinite, the proper measure 
is its power, if it exists. The signal power is the time average of its energy (averaged 
over the entire time interval from k — -00 to 00 ). For periodic signals, the time 
averaging need be performed only over one period in view of the periodic repetition 
of the signal. Signal power is also equal to the mean squared value of the signal 
(averaged over the entire time interval from k = -00 to 00 ). 

Sampling a continuous-time sinusoid cos (u it + 6) at uniform intervals of T 
seconds results in a discrete-time sinusoid cos(fWc+0), where Q = u iT. A continuous 
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time sinusoid of frequency J Hz must be sampled at a rate no less than 2 J- Hz. 
Otherwise, the resulting sinusoid is aliased; that is, it appears as a sampled version 
of a sinusoid of lower frequency. 

Discrete-time signals classification is identical to that of continuous-time sig- 
nals, discussed in chapter 1 . 

A signal /[fc] delayed by m time units (right-shifted) is given by f[k-m]. On 
the other hand, /[fc] advanced (left-shifted) by m time units is given by f[k + m], A 
signal /[it], when time inverted, is given by / [ — fc] . These operations are the same as 
those for the continuous-time case. The case of time scaling, however, is somewhat 
different because of the discrete nature of variable k. Unlike the continuous-time 
case, where time compression results in the same data at a higher speed, time 
compression in the discrete-time case eliminates part of the data. Consequently, 
this operation is called decimation or downsampling. Time expansion operation of 
discrete-time signals results in time expanding the signal, thus creating zero-valued 
samples in between. We can reconstruct the zero- valued samples using interpolation 
from the nonzero samples. The interpolation, thus, creates additional samples in 
between using the interpolation process. For this reason, this operation is called 
interpolation or upsampling. 

Discrete-time systems may be used to process discrete-time signals, or to pro- 
cess continuous-time signals using appropriate interfaces at the input and output. 
At the input, the continuous-time input signal is converted into a discrete-time sig- 
nal through sampling. The resulting discrete-time signal is now processed by the 
discrete-time system yielding a discrete-time output. The output interface now con- 
verts the discrete-time output into a continuous-time output. Discrete-time systems 
are characterized by difference equations. 

Discrete-time systems can be realized by using scalar multipliers, summers, 
and time delays. These operations can be readily performed by digital comput- 
ers. Time delays also can be obtained from charge coupled devices (CCD), bucket 
brigade devices (BBD), and surface acoustic wave devices (SAW). Several advan- 
tages of discrete-time systems over continuous-time systems are discussed in Sec. 
8.5. Because of these advantages, discrete-time systems are replacing continuous- 
time systems in several applications. 
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Problems 

8.2-1 The following signals are in the form e xk . Express them in the form -y k : (a) e~° 

(b) e° 5fc (c) e~i* k (d) e J7rfc . In each case show the locations of A and 7 in the 
complex plane. Verify that an exponential is growing if 7 lies outside the unit circle 
(or if A lies in the RHP), is decaying if 7 lies within the unit circle (or if A lies in the 
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8 Discrete-time Signals and Systems 

LHP), and has a constant amplitude if 7 lies on the unit circle (or if A lies on the 
imaginary axis). 

Repeat Prob. 8.2-1 for the exponentials (a) e tr-t-j-n-Jfc e — (1— i.)* \ e (i+j.)k 

(d) e^~ j ^ k (e) e- (1+ Jf>* (f) . 

State with reason(s) if the following signals are periodic: (a) cos (0.57rit + 0.2) (b) 
cos ( \'2j:k f 1.2) (c) sin (0.5 k I ) (d) r J k . If periodic, determine the period. 
Repeat Prob. 8.2-3 for the signals (a) cos (0.6-irk + 0.2) (b) cos (O.girJc + 1.2) (c) 
cos (0.67rfc + 0.3) + 3 sin (0.5>rJfc + 0.4) + 8cos (0.8;rfc - f ) 

Hint. For parts (a) and (b), use Eq. (8.9b) to determine the period. For part (c), 
if Ni, N 2 , and N 3 are the periods of the three sinusoids, the widths of m x , rn 2 , and 
m 3 number of cycles (mi, m 2 , m 3 integers) of the three sinusoids must be equal for 
the signal to be periodic. 

Determine the fundamental range frequency f ! f for the sinusoids of the frequencies 
12 = (a) 0.87r (b) 1.27r (c) 6.9 (d) 3.77T (e) 22.97T . For each case, determine also the 
lowest frequency which can be used to describe these sinusoids. 

Show that cos (0.6x1: + f ) + v'S cos(1.4rrfc + f ) = 2 cos(0.67rfc - f). 

Express the following exponentials in the form e J '< nfc+e >, where 0 < fl < 2m 
(a) e j< - s - 2,rk+e ) (b) e^ 4nk (c) e - -* 1 ' 95 * (d) 

If f[k] = (0.8) fc tr[fc], find the energies of /[*], -f[k], and c/[fc]. 

Find the energies of the signals depicted in Figs. P8.2-9. 



Fig. P8.2-9 


Find the powers of the signals (1)\ (-1)*, u[k), (-l)*u(Jfc], and cos[|A: + £]. 

Find the powers of the signals illustrated in Fig. P10.1-4 and P10.1-5 (Chapter 10). 

Show that the power of a signal T>e lj ^ k is |D| 2 . Hence, show that the power of a 
signal 


n q - 1 

m = V r e }r ^ k 

r = 0 


N 0 -l 

p f=YL i^-i 2 

r=0 
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8.3- 1 A discrete-time processor uses a sampling interval T = 0.5 / is . What is the highest 

frequency of a signal that can be processed with this processor without aliasing? If a 
signal of frequency 2 MHz is sampled by this processor, what would be the (aliased) 
frequency of the resulting sampled signal? 

8.3- 2 A sampler with sampling interval is T = 0.1 second samples a continuous-time sinu- 

soids 10 cos(ll7rt + f ) and 5 cos(297r£ — f )- Find the expressions for the resulting 
discrete-time sinusoids. Hint: Reduce all discrete-time frequencies to the smallest 
value (in the range 0 to 7r). 

8.3- 3 (a) A signal 10 cos 20007rf + \/2sin 30007 t£ + 2 cos (50007rt + J) is sampled at a rate 

of 4000 Hz (4000 samples/ second). Find the resulting sampled signal. Does this 
sampling rate cause any aliasing? Explain. 

(b) Determine the maximum sampling interval T that can be used to sample the 
signal in (a) without aliasing. 

8.3- 4 A sampler with sampling interval is T = 10 -4 seconds samples continuous-time sinu- 

soids of the following frequencies: T — (i) 1500 Hz (ii) 8,500 Hz (iii) 10 kHz (iv) 
11.5 kHz (v) 32 kHz (vi) 9600 Hz. Determine of what (continuous-time) frequency 
these samples appear in each case. 

8.4- 1 For the signal shown in Fig. P8.2-9b, sketch the signals: (a) f[-k] (b) f[k + 6] (c) 

f[k - 6] (d) f[3k] (e) / [|] without the interpolation of the missing samples. 

8.4- 2 Repeat Prob. 8.4-1 for the signal depicted in Fig. P8.2-9c. 

8.4- 3 Sketch the signals (a) u[fc - 2] - u[fc - 6] (b) fc{u(fc] - u[k - 7]} (c) ( k - 2){u[fc - 

2] - u[fc - 6]} (d ){-k + 8 ){u[k - 6] - u[k - 9]} ( e)(k - 2 ){u[k - 2] - u[k - 6]} + {-k + 
8){u[fc — 6] — u[k — 9]} 

8.4- 4 Describe each of the signals in Fig. P8.2-9 by a single expression valid for all k. 

Hint: Use the expressions of the form in Prob. 8.4-3. 

8.4- 5 If the energy of a signal f[k] is Ef, then show that the energy of f[k — m] is also Ef. 

8-4-6 If the power of a periodic signal f[k) is P/, find the powers and the rms values of (a) 
-f[k] (b) /[— k] (c) f\k — m\ (d) cf[k]. Comment. 

8.5- 1 A cash register output y[fc] represents the total cost of k items rung up by a cashier. 

The input f[k ) is the cost of the kth item. 

(a) Write the difference equation relating y[/c] to f[k]. 

(b) Realize this system using a time-delay element. 

(c) Redo the problem if there is a 10% sales tax. 

8.5- 2 Let p[k] be the population of a certain country at the beginning of the A:th year. 

The birth and death rates of the population during any year are 3.3% and 1.3%, 
respectively. If i[fc] is the total number of immigrants entering the country during the 
fcth year, write the difference equation relating p[k -1- 1], p[Jfe], and t(fc]. 

Hint: Assume that the immigrants enter the country throughout the year at a uniform 
rate, so that their average birth and death rates need to be averaged. 

8.5- 3 For an integrator, the output y(t) is the area under the input f{t) from t — 0 to t. 

Show that the equation of a digital integrator is 

y[k) - y[k - 1] * Tf[k - 1] 

If an input u[fcl is applied to such an integrator, show that the output is a ramp 
kT u[fc]. Hint: £ ?t k = 0, 1, 2, 3, . . . successively in this equation to find y[fe]. 
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L n “St we found the integrator 

input u[k] is kTu[k} + T i[i], which approX^Trl^TrT^ 0 Unit ^ 

8 ' 5 ' 4 th^stoclf market'average V^ b V2y f * t Tf' SUch “ 

its long-term (secular) frend Wet (Up and down ) daily, masking 

averaging the past N values of the x'LaM e ern FOT e thet" te k m ^ ^ Smoothin S or 
consider a five-day moving average vlk) to be the m Sto ^ k market avera ge. we may 
closing values /(*], 4] 6311 ° f the paSt five days ’ marke t 

!b) St t tT 6 " 1 * 6qUati0n relatin S *0 input /[*]. 

( ) Using time-delay elements, realize the five-day moving average filter. 



Fig. P8.5-5 


8.5-5 The voltage at the fcth node of a resistive ladder in Fig. P8.5-5 is „[*] 

( N) - ShOW that satisfi “ ‘he second-order difference equation 

u(fc + 2) - Av[k + 1] + v (fc] = o a = 2 + A 
Hint: Consider the node equation at the fcth node with voltage „[*]. 



Time-Domain Analysis of 
Discrete-Time Systems 


In this chapter we discuss time-domain analysis of LTID (linear time-invariant 
discrete-time systems). The procedure is parallel to that for continuous-time sys- 
tems, with minor differences. y 

9.1 Discrete-Time System equations 

Difference Equations 

ti„nWR U ™ 0nS !f'M- 26) ’ n nd (8 ' 29) are exam P les of difference equations. Equa- 
( ' ) and (®- 29 ) are first-order difference equations, and Eq (8 26) is a 
second-order difference equation. All these equations are linear, with constant (not 
ime- varying) coefficients. Before giving a general form of an nth-order difference 
equation, we recall that a difference equation can be written in two forms; the first 

ir’Tf " term a SUCh “ V[k ~ 1] ’ V[k ~ 2I > f[k - 1 1' / [ fc ~ 2], • • etc., and the 
usefu W ? Tb tCrmS SUCh 35 y[fc + 1] ’ »[* + 2 l- ' • ■> etc - Both forms are 

operato^form a " W “ S 6 ™™' ” th -° rder difference equation, using advance 

y[k + n] + a n . iy [k + n - 1] + • . . + a lV [k + 1] + a 0 y[A:j = 

bmJ\k + m} + 6 m _i/[fc + m - 1] + ■ . . + 6,/[fc + 1) + b 0 f[k] (9.1) 

Observe that the coefficient of y[k + „] can be assumed to be unity without loss 
of generality If this coefficient is other than unity, we can divide the equation 

the form'd! ij*® ^ ^ ° f COefficient of W* + "I to normalize the equation to 

Causality Condition 

The left-hand side of Eq. (9.1) consists of the output at instants k + n, k+n - 1 

st« I*;!’ an , S ° ° n ' The rightdland side of E( I- (9- 1 ) consists of the input at in- 
n s m, +m 1, k+m-2, and so on. For a causal system the output cannot 
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y [k + n] + «„_«[* + B - 1] + - . . + « iy [* + 1] + aoy[k] = 

*“/[* + + K ~ lf[k + «-!] + ■•• + b lf [k + l] + 6 0 /[fc] (9 . 2a) 

Tir ]° me ° f tf ! e T ffiClentS 0n both sides can be zer o. However, the coefficient of 

Eqs (8 25a) and fft 9t,hil q . P , by k n throughout the equation [see 
operator SmTof E, ! K " Pl “* jWd! «” “«™‘™ *™ (0* 

y [ fc l + ~ !] + h o 0 [t - „ + 1 ] + aoJ ,[Jfc _ n j = 

bnf[k] + in-r/I* - 1] + • • • + biflk - n + 1] + boflk - n] (9.2b) 

Sit tTr tor7 <9 ' 2l) - ">» (,2b, ,b« 

91-1 Initial Conditions and Iterative Solntion of Difference Eqnations 

Equation (9.2b) can be expressed as 

y[k] — 0-n-iy{k - 1] — a n _ 2 y[£ - 2] — • • • — aoy[k — nj 

+ b n f[k] + *„_!/[*; - 1] -| + b 0 }[k - n] (9.2c) 

This equation shows that y\k], the output at the *th instant, is computed from 2n + 1 
P .ces of mformatron. These are the past „ values of the output ‘ * ^ - 

\i'--,y[k nj, the past n values of the input: f\k- 1] f\k-2] f\b 1 ’ J*u 
pr«en. vjln. of the inpe, /W . „ lh , lnp P „, jLil/.L /(-1| “ d ‘‘L” 

;l nj 0, and we need only n initial conditions y[— 11 i/f— 21 Tll : = 

allows us to compute iteratively or recursively the output y[0],' 'y[l] y{2\ y [ 3 ] " 

side L 0 ;;,' ^ " “* * = 0 “ ^ ^ iShand 

the inputs /[0], /[ 1] /U2j /( T Th T" ^ ^ ‘ ^ and 
the n initial iondiLt J- j p[ - 2 j ‘ ^ J^Knl T ^ 

ffn -a . , „ z h ■ ■ • > V 1 nj. Knowing these conditions and the 

input /[*], we can iteratively find the response y[0j, y[l], y[2], and so on The 

o owmg examples demonstrate this procedure. This method basically reflectsThe 
i“ t“dSi a COmPUt6r W0UW S ° 1Ve " «*“• S-en the input and 

^orthis^E,. (fiscal, ed .«*»»£. difference equation. However in Eq. ( 9 . 2 ), if 

output yjk] does not require the past vines y[fc" g 1° ^ 

flj = 0, (i — Q l i\ d-u i • rr . i* !fl K "]»*••) etc. ror this reason, when 

important in diigning and realizing filers' In th This cIassification is 

IS not important. The analysis techninnpu . , is chapter, however, this classification 

recursive and nonrecursive systems. Observe thafa nonrJ^ “ - 12) apply to general 

recursive system with on = ai=.. = a ^ n • or _ ecursiv f system is a special case of a 
discussed in Chapter 12. n 1 * esign of recursive an ^ nonrecursive systems is 
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Fig. 9.1 Iterative solution of a difference equation in Example 9.1. 

I Example 9.1 
Solve iteratively 

y[k] - 0.5y[fc - 1] = f[k] ( 9 . 3 a) 

with initial condition y[-l] = 16 and causal input }\k\ = k 2 (starting at k = 0). This 
equation can be expressed as 

w[ fc ] = 0 5 I/[* - 1) + /[fc] (9.3b) 

If we set k = 0 in this equation, we obtain 

y[0] =0.5y[— 1] + /(0] 

=0.5(16) + 0 = 8 

Now, setting k = 1 in Eq. (9.3b) and using the value y[0] = 8 (computed in the first step) 
and /[l] = (l) 2 = 1, we obtain 

»[1] = 0.5(8) + (l) 2 = 5 

Next, setting k = 2 in Eq. (9.3b) and using the value y[l] = 5 (computed in the previous 
step) and /[ 2] = (2) , we obtain 


y(2] = 0.5(5) + (2) 2 = 6.5 
Continuing in this way iteratively, we obtain 


y[3] = 0. 5(6.5) + (3) 2 = 12.25 
y[4] = 0.5(12.25) + (4) 2 = 22.125 


The output y[fc] is depicted in Fig. 9.1. H 

We now present one more example of iterative solution— this time for a second- 
order equation. Iterative method can be applied to a difference equation in delay 
or advance operator form. In Example 9.1 we considered the former. Let us now 
apply the iterative method to the advance operator form. 

I Example 9.2 

Solve iteratively 

y [k + 2] - y jfc + 1] + 0.24 y\k\ = f[k + 2] - 2f[k + 1] (9.4) 

with initial conditions y[-l] = 2, y[-2] = 1 and a causal input /[Jfc] = k (starting at 
k — 0). The system equation can be expressed as 
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y[k + 2] = y\k + 1] - 0.24j /[*] + f[k + 2] - 2 }{k + 1] (9.5) 

Setting k - -2 and then substituting j/[— 1] = 2, y[-2] = 1, /[0] = /[— 1] = 0 (recall that 
f[k] = k starting at k — 0 ), we obtain 

y[0] = 2 - 0.24(1) + 0 - 0 = 1.76 

Setting k — - 1 inEq. (9.5) and then substituting j/[0] = 1.76, y[— 1 ] = 2 , /[l] = l,/[0] = 0, 
we obtain 

y[l] = 1.76 - 0.24(2) + 1 - 0 = 2.28 

Setting k = 0 in Eq. (9.5) and then substituting y[0] = 1.76, y[l] = 2.28, /[ 2] = 2 and 
/[ 1 ] = 1 yields 

y[ 2] = 2.28 - 0.24(1.76) + 2 - 2(1) = 1.8576 

arid so on. B 

Note carefully the iterative or recursive nature of the computations. From the 
n initial conditions (and input) we obtained y [0] first. Then, using this value of 
y [ 0 ] and the previous n - 1 initial conditions (along with the input), we found y [ 1 ] . 
Next, using y [0], y [1] along with the initial conditions and input, we obtained y[2], 
and so on. This method is general and can be applied to a difference equation of 
any order. The iterative procedure cannot be applied to continuous-time systems. 
It is interesting that the hardware realization of Eq. (9.3a) depicted in Fig. 8.17 
(with 7 = 0.5) generates the solution precisely in this (iterative) fashion. 

A Exercise E9.1 

Using the iterative method, find the first three terms of y[fc] if 
y[k + 1 ] - 2y[k] = f[k] 

The initial condition is y[ — 1] = 10 and the input f[k] = 2 starting at k — 0. 

Answer: y[0] = 20,y[l] = 42, andy[2] = 86 . V 

Q Computer Example C9.1 

Solve Example 9.2 using MATLAB. 

7,(c91 .m) 

Y=[l 2]; Y=Y’; 
k=- 2 : 2 ; k=k’; 
f =[0 0 0 ]’; 
for m=l:length(k )-2 

y=Y(m+l)-0.24*Y(m)-|-f(m+2)-2*f(m+l); 

Y=[Y;y]; 

F=m;f=[f;F]; 

end 

stem(k,Y) 

[k Y] 
c91 
ans = 

- 2.0000 1.0000 

- 1.0000 2.0000 

0 1.7600 

1.0000 2.2800 

2 . 0000 0 . 8576 Q 
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We shall see in the future that the solution of a difference equation obtained 
in this direct (iterative) way is useful in many situations. Despite the many uses 
of this method, a closed-form solution of a difference equation is far more useful 
in study of the system behavior and its dependence on the input and the various 
system parameters. For this reason we shall develop a systematic procedure to 
analyze discrete-time systems along lines similar to those used for continuous-time 
systems. 

Operational Notation 

In difference equations it is convenient to use operational notation similar to 
that used in differential equations for the sake of compactness. In continuous- 
time systems we used the operator D to denote the operation of differentiation. 
For discrete-time systems we shall use the operator E to denote the operation for 
advancing the sequence by one time unit. Thus 

Ef\k) = f[k + 1] 

E 2 f[k\ = f[k + 2] 


E n f[k} = f[k + n] (9.6) 

The first-order difference equation of the savings account problem was found 
to be [see Eq. (8.25b)] 

y[k + 1] - ay[k } = f[k + 1] (9.7) 

Using the operational notation, we can express this equation as 

Ey[k] - ay\k ] = Ef[k } 
or 

(E-a)y[k] = Ef[k] (9.8) 

The second-order difference equation (8.26b) 

v\ k + 2] + \ y[k + 1 ] + ^y[fc] = f[k + 2] 
can be expressed in operational notation as 

{E 2 + \E + ±) y[k\ = E 2 f[k] 

A general nth-order difference Eq. (9.2a) can be expressed as 

(E n + a n _i E n 1 + ■ ■ • + aj E + ao)y[fc] = 

{b n E n + fcn-iE "- 1 + --- + b l E + 6 0 )/[fc] 
or 

Q[E)y[k\ = P{E]f[k] 

where Q[E\ and F[E] are nth-order polynomial operators 


(9.9a) 

(9.9b) 
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Q[E] — E + a n ~iE n 1 + ■ ■ ■ + aiE + ao (9.10) 

P[E] = b n E n + b^E"- 1 + • • • + 6 lE + b 0 (g n } 

Response of Linear Discrete-Time Systems 

Following the procedure used for continuous-time systems on p. 105 (footnote) 
we can show that Eq. (9.9) is a linear equation (with constant coefficients). A system 
escribed by such an equation is a linear time-invariant discrete- time (LTID) system 
We can verify, as in the case of LTIC systems (see footnote on p. 105), that the 
general solution of Eq. (9.9) consists of zero-input and zero-state components. 


9.2 System response to Internal Conditions: The Zero-Input 
Response 

The zero-mput response y a {k) is the solution of Eq. (9.9) with f[k\ = 0; that is, 
or <2[F]s/oW = 0 (9.12a) 

or (£" + a n _iE n 1 + ... +aiE -+- no)iro[A] = 0 (9.12b) 


yo[k + n] + a n _ iyo [k + n - 1] + • • • + ai y 0 [fc + 1] + = 0 ( 9 . 12c ) 

We can solve this equation systematically. But even a cursory examination of this 
equation points to its solution. This equation states that a linear combination 
ot y 0 \k\ and advanced j/o [A] is zero not for some values of k, but for all k Such 
situation is possible if and only if y 0 [fc] and advanced j, 0 M have the same form Only 
an exponential function 7* has this property as the following equation indicates. 

-r k+m = y m y k (9.13) 

This equation shows that the delayed -y k is a constant times y k . Therefore the 
solution of Eq. (9.12) must be of the form 

yoM = c 7 * (9. 14 ) 

yields termme ° ^ 7 ’ ** substitute this solution in Eq. (9.12). Equation (9.14) 

Eyo[k] = y 0 [k + 1] = c 7 fc+1 
E 2 Vo[k] = y 0 [k + 2] = cy k+2 

(r\ i 


E n yo{k] = y 0 [k + n] = cj k+n 
Substitution of these results in Eq. (9.12b) yields 


c( 7 + a n _i 7 n 1 + • • • + a l7 + ao)~j k = 0 


(9.16) 


9.2 System response to Internal Conditions: The Zero-Input Response 579 

For a nontrivial solution of this equation 

( 7 n + a„_ l7 n ' 1 + • • • + a i7 + o 0 ) = 0 (9.17a) 

or ’ 

<?M = 0 (9.17b) 

Our solution cy k [Eq. (9.14)] is correct, provided that 7 satisfies Eq. (9.17). Now, 
Qll] is an nth-order polynomial and can be expressed in the factorized form (as- 
suming all distinct roots): 

(7 ~ 7i)(7 - 72) • • • ( 7 - 7fl ) = 0 (9.17c) 

Clearly, 7 has n solutions 7 i, 72. • • • , 7 „ and, therefore, Eq. (9.12) also has n solutions 
c i7i > c 27 2 , - ■ ■ , c n y k . In such a case we have shown (see footnote on p. 106) that 
the general solution is a linear combination of the n solutions. Thus 

3/o[fc] = c, 7 f + C 27 * + • • • + c„ 7 * (9.18) 

where 71,72, ••• ,7 n are the roots of Eq. (9.17) and cj, C2 , . . . ,c„ are arbitrary con- 
stants determined from n auxiliary conditions, generally given in the form of initial 
conditions. The polynomial <?[ 7 ] is called the characteristic polynomial of the 
system, and 

<2fr] = 0 (9.19) 

is the characteristic equation of the system. Moreover, 71,72, • • • , 7n , the roots 
of the characteristic equation, are called characteristic roots or characteristic 
values (also eigenvalues) of the system. The exponentials 7 k (i = 1,2, ... ,n) are 
the characteristic modes or natural modes of the system. A characteristic 
mode corresponds to each characteristic root of the system, and the zero-input 
response is a linear combination of the characteristic modes of the system. 

Repeated Roots 

In the discussion so far we have assumed the system to have n distinct character- 
istic roots 71,72 , . . . ,7„ with corresponding characteristic modes 7 f, 7 £, ,y k . If 
two or more roots coincide (repeated roots), the form of characteristic modes is mod- 
ified. Direct substitution shows that if a root 7 repeats r times (root of multiplicity 
r), the characteristic modes corresponding to this root are 7^, 7^, k r ~ *7^ 

Thus, if the characteristic equation of a system is 

= (7 - 7l) r ( 7 - 7r+l)(7 - 7r+2) • • • (7 - 7n) (9.20) 

the zero-input response of the system is 

y °[*] = (ci + C2k+C3 fc2 + ' • ■ + Crfc '"~ 1 )7l +Cr+17^ +1 + c r+27r+2 + ' • +c n y k (9.21) 

Complex Roots 

As in the case of continuous-time systems, the complex roots of a discrete-time 
system must occur in pairs of conjugates so that the system equation coefficients 
are real. Complex roots can be treated exactly as we would treat real roots. How- 
ever, just as in the case of continuous-time systems, we can eliminate dealing with 
complex numbers by using the real form of the solution. 
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First we express the complex conjugate roots 7 and 7 * in polar form. If | 7 | is 
the magnitude and 0 is the angle of 7 , then 

7 = | 7 | e J/J and 7 * = \^\e~^ 

The zero-input response is given by 

J/oM =Cl7 fc + c 2 (7*) fc 

= C l|7|V^ + c 2 | 7 | fc e-^ 

For a real system, ci and c 2 must be conjugates so that y 0 [k] is a real function of 
k. Let 

Then c l = fe 2 ® and c 2 = § e~ j6 

yoW =f bf + e -J(»+*)J 

=C M* cos (0k + 0) (9.22) 

where c and 0 are arbitrary constants determined from the auxiliary conditions. 
This is the solution in real form, which avoids dealing with complex numbers. 

B Example 9.3 

(a) For an LTID system described by the difference equation 


vl k + 2 ] ~ 0.6# + 1] - 0.16#] = 5 }[k + 2] (9.23a) 

find the total response if the initial conditions are y[-l] = 0 and y[-2] = — , and if the 
input /[fc] = 4“*#]. In this example we shall determine the zero-input component j#] 
only. The zero-state component is determined later in Example 9.7. 

The system equation in operational notation is 

(E 2 - 0.6 E - 0.16)#] = 5 E 2 f[k] (9.23b) 

The characteristic polynomial is 

7 2 - O.67 - 0.16 = (7 + 0.2)(7 - 0.8) 

The characteristic equation is 

(7 + 0.2)( 7 - 0.8) = 0 (9.24) 

The characteristic roots are 7l = -0.2 and 72 = 0.8. The zero-input response is 

2#] = e 1 (-0.2) fc + 02(0.8)* (9.25) 

To determine arbitrary constants ci and c 2 , we set k — -1 and -2 in Eq. (9.25) then 
substitute j/o[ 1] — 0 and 3/0 [ — 2] = 77 to obtain) 


Therefore 


0 = -5ci + |c 2 'l ci =i 

T =25ci + §c 2 J ^ C2 =| 

yo[fc] = s(-0.2)* + |(0.8)* 


(9.26) 


jThe initial conditions #1] and #2] are the conditions given on the total response. But because 
the input does not start until k = 0, the zero-state response is zero for k < 0. Hence, at k = -1 
a , „. _ tl1 ® t °J al res Ponse consists of only the zero-input component, so that y(-l] = yo[-l| and 
2/1 4 — 3/01 — 2j . 
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The reader can verify this solution by computing the first few terms using the iterative 
method (see Examples 9.1 and 9.2). 

(b) A similar procedure may be followed for repeated roots. For instance, for a 
system specified by the equation 

(E 2 + 6 E + 9)y[k] = (2 E 2 + 6£)/[fc] 

determine y#], the zero-input component of the response if the initial conditions are 
yo(— 1] — — | and yo[— 2] = — 

The characteristic polynomial is 7 2 + 67 + 9 = (7 + 3) 2 , and we have a repeated 
characteristic root at 7 = -3. The characteristic modes are (-3)* and k(- 3)*. Hence, 
the zero-input response is 

yo[fc] = (ci + c 2 fc)(- 3)* 

We can determine the arbitrary constants ci and c 2 from the initial conditions following 
the procedure in part (a). It is left as an exercise for the reader to show that c\ = 4 and 
C2 = 3 so that 

3/o[fc] = (4 + 3fc)(— 3)* 

(c) For the case of complex roots, let us find the zero-input response of an LTID 
system described by the equation 

(E 2 - 1.56E + 0.81)y[fc] = (E + 3)/[fc] 

when the initial conditions are yo[-l] = 2 and yo[-2] = 1. 

The characteristic polynomial is (7 2 -1.56 7 +0.81) = (7-0. 78-jO. 45)(7~0.78-t jO 45). 
The characteristic roots are 0.78±j0.45; that is, 0.9e ±} i. Thus, | 7 | = 0.9 and 0 = tt/ 6, 
and the zero-input response, according to Eq. (9.22), is given by 

yo[fc] = c(0.9)* cos (|fc + 9) 

To determine the arbitrary constants c and 0, we set k = -1 and -2 in this equation and 
substituting the initial conditions yo[-l] = 2, y 0 [-2] = 1, we obtain 


or 


2 #9 cos (“i + *) = [t cos *+ 

1= (o§F os H + *) = 5^I jcose + ^sine 


y-| c cos 0 + T, c sin 0 = 2 
7^2 c cos 9 + 7^ c sin 0 = 1 


These are two simultaneous equations in two unknowns ccos 0 and csin 0. Solution of 
these equations yields 


c cos 0 =2.308 
csin 6 = — 0.397 


Dividing csin 9 by ccos 9 yields 
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2/o[fc] = 2.34(0.9)* cos (|k — 0.17) fc>0 

Observe that here we have used radian unit for both 0 and 9. We also could have used 
the degree unit, although it is not recommended. The important consideration is to be 
consistent and to use the same units for both 0 and 0. I 

A Exercise E9.2 

Find and sketch the zero-input response for the systems described by the following equations: 
(a) y[k + 1] - 0.8y[k] = 3 f[k + 1] (b) y[k + 1] + 0.8y[fc] = 3 f[k + 1], 

In each case the initial condition is j/{ — X] = 10. Verify the solutions by computing the first 
three terms using the iterative method. 

Answer: (a) 8(0.8) fc (b) -8(-0.8)*\ v 
A Exercise E9.3 

Find the zero-input response of a system described by the equation 

y[fc] + 0.3y[k - 1] - 0.1 y[k - 2] = f[k] + 2 }[k - 1] 

The initial conditions are yo[— 1] — 1 and yo[— 2] = 33. Verify the solution by computing the 
first three terms iteratively. 

Answer: y a {k\ = (0.2)* +- 2(-0.5) ,! V 
A Exercise E9.4 

Find the zero-input response of a system described by the equation 
y[fcj + 4y[*-2] = 2/[fc] 

The initial conditions are yo [ 1 ] = — and yo[~2] = . Verify the solution by computing 

the first three terms iteratively. 

Answer: y 0 [fc] = (2) fc cos (f k - ^) V 

O Computer Example C9.2 

Find and sketch the zero-input response for the system described by 


(E 2 - 1.56 E + 0.81)y[fc] = (E + 3)/[fc] 


using the initial conditions y[-l]=2, and y[-2]=l. 

y=[l 2]; y=y’; 
k=-2:16; k=k’; 
for m=l:length(k)-2 

Y=1.56*y(m+l)-0.81*y(m); 

Yzi=[Yzi;Y]; 

end 

stem(k,Yzi) Q 
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9.3 The Unit Impulse Response h[k] 

Consider an nth-order system specified by the equation 

( E n + a n —\E n 1 + ■ ■ • + a\E + ao)y[k] = 

(b n E n + bn-iE"" 1 + • - • + biE + b 0 )f\k] (9.27a) 

or 

Q[E\y[k\ = P[E]f[k} (9.27b) 

The unit impulse response MM is the solution of this equation for the input 6 [jfc] 
with all the initial conditions zero; that is, 

<3[£]MM = p l E Mk] (9-28) 

subject to initial conditions 

fc[— 1] = ft[— 2] = - • - = ft[— n] = 0 (9.29) 

Equation (9.28) can be solved to determine h[k\ iteratively or in a closed form. The 
following example demonstrates the iterative solution. 

H Example 9.4: Iterative Determination of h[k] 

Find h[k], the unit impulse response of a system described by the equation 

y[fc] - 0.6y[fc - 1] - 0.16y[fe - 2] = 5/(fc] (9.30) 

To determine the unit impulse response, we must let the input f[k) = 5[fc] and the 
output y[k] = h[fc] in the above equation. The resulting equation is 

h[k] - 0.6/t(fc - 1] - 0.16/i[k - 2] = 5i5[fc] (9.31) 

subject to zero initial state; that is, ft[— 1] = h[-2] = 0. 

Setting k = 0 in this equation yields 

h[0] - 0.6(0) - 0.16(0) = 5(1) ==k M0] = 5 

Next, setting k = 1 in Eq. (9.31) and using h[0] = 5, we obtain 

Ml] ~ 0.6(5) - 0.16(0) = 5(0) =k Ml] = 3 ■ 

Continuing this way, we can determine any number of terms of h[fc]. Unfortu- 
nately, such a solution does not yield a closed-form expression for h\k). Nevertheless, 
determining a few values of h[k] can be useful in determining the closed-form solu- 
tion, as the following development shows. 

The Closed-Form Solution of h[k] 

Recall that h[k] is the system response to input 6[k], which is zero for k > 0. 
We know that when the input is zero, only the characteristic modes can be sustained 
by the system. Therefore, h[k] must be made up of characteristic modes for k > 0. 
At k = 0, it may have some nonzero value Aq, so that h[k] can be expressed as 


MM = ^oMM + Jfn[M 


(9.32) 
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where, y n [k] is a linear combination of the characteristic modes. In Appendix 9.1 
we show that 

A 0 = — (9.33) 

a 0 ' 

Moreover, because ft[fc] is causal, we must multiply y n [fc] by u[k], Therefore, } 

h[k] = — <5[fc] + y„[fc]u[fc) (9.34) 

The n unknown coefficients in y n [k] (on the right-hand side) can be determined 
from a knowledge of n values of h[k}. Fortunately, it is a straightforward task to 
determine values of ft[fc] iteratively, as demonstrated in Example 9.4. We compute 
n v-alues A [0] , ft[l}, ft [2], • ■ ■ , ft[n - 1] iteratively. Now, setting k = 0, 1,2, • • • ,n — 1 
in Eq. (9.34), we can determine the n unknowns in y n [k]. This point will become 
clear in the following example. 

■ Example 9.5 

Determine the unit impulse response ft[fc] for a system in Example 9.4 specified by 
the equation 

y[k] - 0.6y[fc - 1] - 0.16# - 2] = 5/[k] 

This equation can be expressed in the advance operator form as 

y\k + 2] - 0.6y[fc + 1] - 0.16#] = 5/[fc + 2] (9.35) 


(. E 2 - 0.6£ - 0.16)#] = 5E 2 /(fc] 
The characteristic polynomial is 

7 2 - O.67 - 0.16 = (7 + 0.2)(7 - 0.8) 
The characteristic modes are (-0.2)* and (0.8)*. Therefore 


y n [k\ = Ci (—0.2)* + 02(0.8)* (9.37) 

Also, from Eq. (9.36), we have ao = —0.16 and 60 = 0. Therefore, according to Eq. (9.34) 

ft[fc] = [ci(— 0.2)* + C2(0.8)*]ti[ft) (9.38) 

To determine ci and C2, we need to find two values of h[k\ iteratively. This step is already 
taken in Example 9.4, where we determined that ft[0] = 5 and ft[l] = 3. Now, setting 
fc = 0 and 1 in Eq. (9.38) and using the fact that ft[0] = 5 and ft[l] = 3, we obtain 

5 = Cl + C2 | ci = 1 

3 = — 0.2ci + 0.8C2 J C2 — 4 

{We showed that ft[fc] consists of characteristic modes only for k > 0. Hence, the characteristic 
mode terms in ftffc] start at k = 1. To reflect this behavior, they should be expressed in the form 
y , “[* - !)■ But because u[fc - 1] = u[fc] - A, 7 *# - 1] = Aj 7 *u[fc] - Aj8[fc], and h[k] can 
be expressed in terms of exponentials 7 *u[fc] (which start at fc = 0), plus an impulse at fc = 0. 
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Therefore 

ft[fc] = [(-0.2)* + 4(0.8)*] u[fc] 


O Computer Example C9.3 

Solve Example 9.5 using Matlab. 

There are several ways of finding impulse response by Matlab. In this method, we 
specify the system and the input by a, b, and f vectors. The response is plotted for 20 
points. This program can be used to find the discrete-time system response to tiny input. 

N=20; 

b=[5 0 0]; 

a=[l -0.6 -0.16]; 

f=[l,zeros(l,N-l)]; 

y=filter(b,a,f); 

k=0:l:N-l; 

stem(k,y) 

xlal>el(’k’);ylabel('h[k] ’); Q 

Comment 

Although determination of the impulse response A [fc] using the procedure in this 
section is relatively simple, in Chapter 11 we shall discuss another, much simpler, 
method of z-transform. 

In the present method, when ao = 0, Ao cannot be determined from Eq. (9.33). 
It is shown in Appendix 9.1 that in such a case the impulse response contains an 
additional impulse at fc = 1, and ft[fc] can be expressed as 

ft[fc] = A 0 <5[fc] + Aii5[fc - 1] + y n [fc]u[fc] 

Now ft[fc] contains n + 2 unknowns (Ao, A], and n coefficients of y„[fc]), which can 
be determined from n + 2 values of ft[fc] obtained iteratively. 

A Exercise E9.5 

Find ft[fc], the unit impulse response of the LTID systems specified by the following equations: 

(a) y|fc + 2] - 5y[fc + 1] + 6y [fc] = 8/[fc + 1] - 19/[fc] 

(b) y[k + 2] - 4y [fc + 1] + 4y(fc] = 2/[fc + 2] - 2/[fc + 1] 

Answers: 

(a) ft[fc] = -f«|fc) + [|(2)* + |(3)*]u[fcl 

(b) ft|fc] = (2 + fc)2*u[fc] 


9.4 System Response to External Input: The Zero-State 
Response 

The zero-state response y[k] is the system response to an input /[fc] when the 
system is in zero state. In this section we shall assume that systems are in zero 
state unless mentioned otherwise, so that the zero-state response will be the total 
response of the system. Here we follow the procedure parallel to that used in the 
continuous-time case by expressing an arbitrary input /[fc] as a sum of impulse 
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/[0]8[*J 


(<0 



Fig. 9.2 Representation of an arbitrary signal f[k] in terms of impulse components. 

components. Figure 9.2 shows how a signal f[k] in Fig. 9.2a can be expressed as 
a sum of impulse components such as those depicted in Figs. 9.2 b, c, d, e, and f. 
The component of f[k] at k = m is }[m}6\k - m], and /[it] is the sum of all these 
components summed from m = — oo to oo. Therefore 

/[*] = /[0]«[*1 + /[l]<(fc - 1] + f[2]6[k - 2] + • • . 

+ f[-l]6[k + 1] + f[-2]S[k + 2] + • ■ ■ 

OO 

= ^2 f\m\S[k — m\ 


m=— oo 


(9.40) 
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If we knew the system response to impulse <5 [A] , the system response to any arbi- 
trary input could be obtained by summing the system response to various impulse 
components. Let h[k\ be the system response to impulse input 6[fc[. We shall use 
the notation 

/[*] =*■ J/[A] 

to indicate the input and the corresponding response of the system. Thus, if 

5[fc] =4- h[k ] 


then because of time invariance 


8[k — m] ==>• — m] 


and because of linearity 


f[m]S[k - m] =>■ f[m]h[k — m] 
and again because of linearity 


Y2 /M<5[fc ■ 


r f[m]h[k - ! 



The left-hand side is f[k\ [see Eq. (9.40)], and the right-hand side is the system 
response y[k] to input f[k]. Therefore 


OO 

v\ k ) = Y2 /MM* ~ H (9-41) 

m=— oo 


The summation on the right-hand side is known as the convolution sum of / [fc] 
and h[fc], and is represented symbolically by / [fc] * h[fc] 

OO 

f[k]*h[k]= f[m]h[k - m] (9-42) 

m— — oo 


Properties of the Convolution Sum 

The structure of the convolution sum is similar to that of the convolution 
integral. Moreover, the properties of the convolution sum are similar to those of 
the convolution integral. We shall enumerate these properties here without proof. 
The proofs are similar to those for the convolution integral and may be derived by 
the reader. 

1. The Commutative Property 

/i[*]*/ 2 [*] = /2[fc]*/iW (9-43) 

2. The Distributive Property 


/l t fe ] * (/ 2 W + h[k]) = /i[k] * / 2 [fc] + h[k] * / 3 [fc) 


(9.44) 
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3. The Associative Property 

/iM * (M k ) * /■#]) = (/i[fc] * /2W) * h[k] (9.45) 

4. The Shifting Property 

If 

, h[k\* S 2 \k} = c[k) 

then+ 

f\[k - m] * / 2 [fc - n] = c[fc - m - n] (9.46) 

5. The Convolution with an Impulse 


f[k]*6[k} = f[k] (9.47) 

6. The Width Property 

If /i[fc] and / 2 [fc] have lengths of m and n elements respectively, then the 
length of c[fc] is m + n - 1 elements.) The width property may appear to be 
violated in some special cases as explained on p. 136. 


Causality and Zero-State Response 

In deriving Eq. (9.41), we assumed the system to be linear and time-invariant. 
There were no other restrictions on either the input signal or the system. In practice, 
almost all of the input signals are causal, and a majority of the systems are also 
causal. These restrictions further simplify the limits of the sum in Eq. (9.41). If 
the input /[A] is causal, /[m] = 0 for m < 0. Similarly, if the system is causal (that 
is, if h.[k] is causal), then h[x] = 0 for negative x, so that h{k - m] = 0 when m > k. 
Therefore, if f\k] and h[k] are both causal, the product f[m\h\k - m] = 0 for m < 0 
and for m > fc, and it is nonzero only for the range 0 < m < k. Therefore, Eq. 
(9.41) in this case reduces to 

k 

y[ fc ] = fl m \ h \k - H (9.48) 

m— 0 

We shall evaluate the convolution sum first by an analytical method and later 
with graphical aid. 


I Example 9.6 

Determine c[fc] = f[k] * g[fc] for 

/[fc] = (0.8)*u[fc[ and g[k ] = (0.3)*u[fc[ (9.49) 

We have 

00 

c[fc] = fVn}g\k - m } 

m= — 00 

Note that 

/ M = (0.8) m u[m] and g[k - m) = (0.3) fc_m u[fc - m] (9.50) 

Both /[A:] and g[fc] are causal. Therefore, [see Eq. (9.48)] 

t.The width of a signal is one less than the number of its elements (length). For instance, the 
signal in Fig. 9.3h has 6 elements, but has a width of only 5. Thus, if /,[*] and / 2 [fc] have widths 
of Wi and H' 2 , respectively, then the width of c[fc] is + tf' 2 . 
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c[k\ = Y2 fl m }9[k - H 

m=0 

k 

— ^^(0.8) m u[m] (0.3 ) k ~ m u[k — m] (9.51) 

m=0 

In the above summation, m lies between 0 and k (0 < m < fc). Therefore, if k > 0, then 
both m and k ~ m > 0, so that u[m\ = u[k — m\ ~ 1. If k < 0, m is negative because m 
lies between 0 and k, and u[m] = 0. Therefore, Eq. (9.51) becomes 

k 

c\k\ =^(0.8) m (0.3) fc “ m fc > 0 


c[fc] = (0.3)‘^(5|) m u[fc] 

m=0 

This is a geometric progression with common ratio (0.8/0.3). FYom Sec. B.7-4 we have 

n, -,t (0-8)* +1 -(0.3) w . , 

W { °’ 3) (0.3) fc (0.8 - 0.3) W 

=2 [{0.8) fc ' H1 - (0.3) fc+1 ] u(fc] (9.52) 

A Exercise E9.6 H 

Show that (0.8) t u[fc] » u\k\ = 5[1 — (0.8) fc+1 ]u[fc] V 

Convolution Sum from a Table 

Just as in the continuous-time case, we have prepared a table of convolution 
sums (Table 9.1) from which convolution sums may be determined directly for a 
variety of signal pairs. For example, the convolution in Example 9.6 can be read 
directly from this table (Pair 4) as 

(0.8)*u[fc] * (0.3)Mfc] = (0 ' 8 C:~i,°o 3)fc+1 “W = 2[(0.8)* +1 - (0.3) fc+1 ]u[fc] 


0.8 - 0.3 


We shall demonstrate the use of the convolution table in the following example. 
I Example 9.7 

Find the (zero-state) response y[fc] of an LTID system described by the equation 
y[k + 2] - 0.6y[fc + 1] - 0.16y[fc] = 5/[fc + 2] 
if the input /[fc] = 4 — fc zt[fc[. 

The unit impulse response of this system is obtained in Example 9.5. 


Therefore 


/i[fc] = [(— 0.2) fc + 4(0.8) fc ]u[fc] 


y[k] =/[fc] * Mfc] 

=(4) k u[fc] * [(— 0.2) fc u[fc] + 4(0.8) fc «[fc]J 
=(4)“' t ti[fc) * (— 0.2) fc u[fc] + (4 )~ k u[k] * 4(0.8) fc u[fc] 


(9.54) 
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Note that 

(4)~*u[fc] = (i) u [fc] = (0.25)*u[fc] 

Therefore 

y[k] = (0.25)*u[fc] * (— 0.2) fc tx[fc] + 4(0.25)*u[A:] * (0.8)*«[fc] 

We use Pair 4 (Table 9.1) to find the above convolution sums. 

f (°- 25 ) W -(-0.2)* +1 (0.25)*+*- (0.8)*+* 

0.25 - (-0.2) + 4 0.25 - 0.8 J 

= (2.22 [(D.25)* +1 - (-0.2)* +1 ] - 7.27 [(0.25)* +1 - (0.8)* +1 ]) u[fc] 

= [-5.05(0.25)* +1 - 2.22(-0.2)* +1 + 7.27(0.8)* +1 ] „[*] 

Recognizing that 

7* +1 = 7(7)* 

We can express y[k] as 

y[fc] = [-1.26(0.25)* + 0.444(— 0.2)* + 5.81(0.8)*] u[k] 

= [-1.26(4)-* + 0.444(— 0.2)* + 5.81(0.8)*] u[fc] (9.55) 

■ 

A Exercise E9.7 

Show that (0.8)* +1 u[fc] * u[k] = 4[1 - 0.8(0.8)*]u[fc] 

Use convolution table. Recognize that (0.8)* +1 = 0.8(0 8)* y 

A Exercise E9.8 

Show that k 3“*u[fc] » (0.2)*u[fc] = ^ [(0.2)* - (1 - |*)3- fc ]u[A:] 

Hint: Use convolution table. Recognize that 3 -fc = (I)* y 

A Exercise E9.9 

Using convolution table, show that e~ k u[k] * 2 ~ k u[k] = -2_[ e -* _ «2 ~ k ]u[k\ 

Hint: e~ k = (i)* and 2“* = (0.5)* y 

o Computer Example C9.4 

Find and sketch the zero-state response for the system described by 
(E 2 + 6 E + 9)y[fc] = (2 E 2 + 6 E)f[k\ 

for the input f[k ] = 4*u[fc]. 

k=0:ll; 
b=[2 6 0]; 
a=[l 6 9]; 
f=4.'(k); 
y=filter(b,a,f); 
stem(k,y) 

Xlabel(’k’);ylabel(’y[k]’); © 
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9.4-1 Graphical Procedure for the Convolution Sum 

The steps in evaluating the convolution sum are parallel to those followed in 
evaluating the convolution integral. The convolution sum of causal signals /[fc] and 
g [A;] is given by 

k 

<#] = - to ] 

m=0 

We first plot /[m] and g[k - m] as functions of m (not fc), because the summation is 
over m. Functions f[m\ and g[m] are the same as /[fc] and g[fc], plotted respectively 
48 functions of m (see Fig. 9.3). The convolution operation can be performed as 
follows: 

1. Invert g\m\ about the vertical axis (m = 0) to obtain g[-m] (Fig. 9.3d). Figure 
9.3e shows both /[m] and g[-m\. 

2. Time shift g{-m] by k units to obtain g[k - m]. For k > 0, the shift is to the 
right (delay); for k < 0 , the shift is to the left (advance). Figures 9.3f and 9.3g 
show g[k - m] for fc > 0 and for k < 0, respectively. 

3. Next we multiply f[m] and g[k - m] and add all the products to obtain c[fc]. 
The procedure is repeated for each value of k over the range -oo to oo. 

We shall demonstrate by an example the graphical procedure for finding the 
convolution sum. Although both the functions in this example are causal, the 
procedure is applicable to general case. 

H Example 9.8 
Find 

c[fc] =/[*)* g[fc] 

where }\k\ and g[k\ are depicted in Figs. 9.3a and 9.3b, respectively. 

We are given 

f[k\ = (0.8)* and g[fcj = (0.3)* 

Therefore 

/[m] = (0.8) m and g[k - m] = (0.3)*“ m 

Figure 9.3f shows the general situation for fc > 0. The two functions /[m] and g[k - m] 
overlap over the interval 0 < m < k. Therefore 

fc 

4k] = ^ f[m]g[k - m] 

m=0 

fc 

= ^(0.8) m (0.3)*~ m 

m=0 

m=0 

=2 [(0.8)* +1 - (0.3)* +1 ] k > 0 (see Sec. B.7-4) 

For k < 0, there is no overlap between f[m ] and g(fc - m], as shown in Fig. 9.3g so that 

c[fc] =0 k < 0 

and 

c[k] = 2 [(0.8)* +1 - (0.3)* +1 ] u[fc] 
which agrees with the earlier result in Eq. (9.52). ■ 


(9.56) 



1 



Fig. 9.3 Graphical understanding of convolution of /[fc] and g[fc] for Example 9.7. 
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A Exercise E9.10 

Find (0.8) fc u[k] * u[fc] graphically and sketch the result. 

Answer: 5(1 - (0.8) k+l )u[fc] v 

An Alternative Form of Graphical Procedure: The Sliding Tape Method 

This algorithm is convenient when the sequences f[k] and p[fc] are short or when 
they are available only in graphical form. The algorithm is basically the same as the 
graphical procedure in Fig. 9.3. The only difference is that instead of presenting the 
data as graphical plots, we display it as a sequence of numbers on tapes. Otherwise 
the procedure is the same, as will become clear in the following example. 

I Example 9.9 

Using the sliding tape method, convolve the two sequences /[fc]andff[fc] depicted in 
Fig. 9.4a and 9.4b, respectively. In this procedure we write the sequences f[k] and pjlfc] in 
the slots of two tapes: / tape and g tape (Fig. 9.4c). Now leave the / tape stationary (to 
correspond to /[m]). The g[—m] tape is obtained by time inverting the g[m] tape about 
the origin (k = 0) so that the slots corresponding to /[0] and g[0] remain aligned (Fig. 
9.4d). We now shift the inverted tape by k slots, multiply values on two tapes in adjacent 
slots, and add all the products to find c[fc]. Figures 9.4d, e, f, g, h, i, and j show the cases 
for k = 0, 1, 2, 3, 4, 5, and 6, respectively. For the case of k = 0, for example (Fig. 9.4d) 



c[2] =(0 x 1) + (1 x 1) + (2 x 1) = 3 

c[3] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) = 6 

c[4] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) + (4 x 1) = 10 

c[5] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) + (4 x 1) + (5 x 1) = 15 

c[6] =(0 x 1) + (1 x 1) + (2 x 1) + (3 x 1) + (4 x 1) + (5 x 1) = 15 

Figure 9.4j shows that c[k] — 15 for k > 5. Moreover, the two tapes are nonoverlap- 
ping for k < 0, so that c[fc] = 0 for k < 0. Figure 9.4k shows the plot of c[fc] . ■ 

Q Computer Example C9.5 

Using Matlab, find the convolution of f[k] and g[k] depicted in Fig. 9.5. 

f=[0 1 2 3 2 1]; 

g=[l 11111]; 
k= 0 :l:length(f)-Flength(g)- 2 ; 

c=conv(f,g); 

stem(k,c) Q 

An Array Form of Graphical Procedure 

The convolution sum cam also be obtained from the array formed by sequences 
/[fc] and s[k]. This procedure, although convenient from a computational viewpoint, 
fails to give proper understanding of the convolution mechanism. The procedure is 
explained in Prob. 9.4-16. 
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m=0 

l 




fw 


f ta P e 0 1 2 3 4 5 

— » 

«- S [-"■] 

0 1 2 3 4 5 

c[0] = 0 

k tape 1 1 1 1 1 1 1 • • • 

-4 

• • • 111111 

1 -> k = 0 


^ J (C) 

(d) 



rotate the g-tape about the 


0 1 2 3 4| 5 

c[l] = l 

verticle axis as showen in (d) 

• • • 11111 

1 1 -> 4= 1 



(e) 





0 1 2 3 4 5 

c[2] = 3 


• • . 1111 

1 1 1 ->* = 2 



(f) 





0 1 2 3 4 5 

c[3] = 6 


• • • 111 

1111 ->k = 3 



(g) 





0 1 2 3 4 5 

c[4] = 10 


... 1 1 

liiii -»*= 

4 


(h) 





Fig. 9.4 Sliding tape algorithm for discrete-time convolution. 
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Fig. 9.5 Signals for Exercise E9.ll. 

A Exercise E9.1X 

Using the graphical procedure of Example 9.9 (sliding-tape technique), show that f[k\ »o[fcl = 
c(fc] in Fig. 9.5. Verify the width property of convolution. sy 

9.4-2 A Very Special Function For LTID Systems: The Everlasting 
Exponential z* 

2 ' 4 ' 3 ’ we showed that there exists one signal for which the response 
oi an LI IC system is the same as the input within a multiplicative constant. The 
response of an LTIC system to an everlasting exponential input e’ ( is H{s)e st 1 where 
H(s) is the system transfer function. We now show that for an LTID system, the 
same role is played by an everlasting exponential z k . The system response yffcl in 
this case is given by 

2/[fc] = * z k 

oo 

= E 

m =— oo 
oo 

= 2* E 

m=— oo 

For causal A[fc], the limits on the sum on the right-hand side would range from 0 to 
oo. In any case, this sum is a function of z. Let us denote it by H[z\. Thus,) 

y[k] = H[z]z k (9.57a) 

where 

oo 

= E h [ m ) z ~ m (9.57b) 

m=— oo 

(This result is valid only for the values of z for which the exists (or converges). 
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Note that H[z] is a constant for a given z. Thus, the input and the output are the 
same (within a multiplicative constant) for the everlasting exponential input z k . 

H[z\, which is called the transfer function of the system, is a function of the 
complex variable z. We can define the transfer function H[z\ of an LTID system 
from Eq. (9.57a) as 

... output signal 

ti \z\ = 

input signal 

A Exercise E9.12 

Show that the transfer function of the digital differentiator in Example 8.7 (big shaded block 
in Fig. 8.20b) is given by H[z] = . y 

9.4-3 Total Response 

The total response of an LTID system can be expressed as a sum of the zero- 
input and zero-state components: 

n 

Total response = E c j7j + /[fc] * A[fc] 

) Zero-state component 

Zero-input component 

In this expression, the zero-input component should be appropriately modified for 
the case of repeated roots. We have developed procedures to determine these two 
components. From the system equation we find the characteristic roots and charac- 
teristic modes. The zero-input response is a linear combination of the characteristic 
modes. From the system equation we also determine A[fc], the impulse response, 
as discussed in Sec. 9.3. Knowing /i [fc] and the input f[k\, we find the zero-state 
response as the convolution of f\k] and fcffc]. The arbitrary constants c x , c 2 , . . . , c„ 
in the zero-input response are determined from the n auxiliary conditions. For the 
system described by the equation 

y\k + 2] - 0.6y[fc + 1] - 0.16y[&] = 5 f[k + 2] 

with initial conditions y[— 1] = 0, y[— 2] = ^ and input f[k] = (4) _ *u[Jfe], we have 
determined the two components of the response in Examples 9.3a and 9.7 respec- 
tively. From the results in these examples, the total response for k > 0 is 


(9.58) 

Input— everlasting exponential z k 


Total response = O2(-0.2)* + 0.8(0.8)* — 1.26(4) _fc 4- 0.444(-0.2)* + 5.81(0.8)* 


Zero-input component 


Zero-state component 


Natural and Forced Response 

The characteristic modes of this system are (-0.2)* and (0.8)* . The zero-input 
component is made up of characteristic modes exclusively as expected, but the char- 
acteristic modes also appear in the zero-state response. When all the characteristic 
mode terms in the total response are lumped together, the resulting component is 
the natural response. The remaining part of the total response that is made up of 
noncharacteristic modes is the forced response. For the present case, Eq. (9.59) 
yields 
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9.5 Classical solution of Linear Difference Equations 

As in the case of LTIC systems, we can analyze LTID systems by using the 
classical method, where the response is obtained as a sum of natural and forced 
components of the response. 

Finding Natural and Forced Response 

As explained earlier, the natural response of a system consists of all the charac- 
teristic mode terms in the response. The remaining noncharacteristic mode terms 
form the forced response. If y„[A:] and y^[k\ denote the natural and the forced 
response respectively, then the total response is given by 

Total response = y4fc] + y^ (9.61) 

modes nonmodes 

Because the total response y n [k] + y^fc] is a solution of the system equation (9.9) 
we have 

Q\ E ] (s/nM + y<t,[k\) = P[E)f[k] (9.62) 

But since y n [/c] is made up of characteristic modes, 

<9[ £ W*]=0 (9.63) 

Substitution of this equation in Eq. (9.62) yields 

Q[E)V4>[k\ = P[E\}[k\ (9.64) 

The natural response is a linear combination of characteristic modes. The arbitrary 
constants (multipliers) are determined from suitable auxiliary conditions usually 
given as y[0], y[l], .... y[n - 1]. We now turn our attention to the forced response. 

Forced Response 

(9 ^ aVe s ^ own the forced response y^[fc] satisfies the system Equation 

Q[E} y4> [k] = P[E]f[k\ 

By definition, the forced response contains only nonmode terms. To determine 
the forced response, we shall use a method of undetermined coefficients, the same 
method used for the continuous-time system. However, rather than retracing all 
the steps of the continuous-time system, we shall present a table (Table 9.2) listing 
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the inputs and the corresponding forms of forced function with undetermined co- 
efficients. These coefficients can be determined by substituting y^[k\ in Eq. (9.64) 
and equating the coefficients of similar terms. 

Table 9.2 


Input f[k] Forced Response y^[fc] 

1. r k r / 7 j (i = 1, 2, • • ■ , n) cr k 

2. r k r = ckr k 

3. cos (0k + 0) 

, (!>■),. 

Note: By definition, y$[A:] cannot have any characteristic mode terms. If any terms 
shown in the right-hand column for the forced response should also be a characteristic 
mode of the system, the correct form of the forced response must be modified to k'y^,[k], 
where i is the smallest integer that will prevent k'y^,[k\ from having a characteristic mode 
term. For example, when the input is r k , the forced response in the right-hand column is 
of the form cr k . But if r k happens to be a natural mode of the system, the correct form 
of the forced response is ckr k ( see Pair 2). 


ccos (0k + <j>) 



I Example 9.10 

Solve 

(E 2 -5 E + 6 )y[fc] = (E - 5 )f[k] (9.65) 

if the input f[k] = (3fc 4- 5)u[fc] and the auxiliary conditions are j/[0] = 4, j/[l] = 13. 

The characteristic equation is 

7 2 - 5q + 6 = (7 - 2) (7 - 3) = 0 

Therefore, the natural response is 

yn[fc] = Bi(2) k + B 2 (3) k (9.66) 

To find the form of forced response y$[k], we use Table 9.2, Pair 4 with r = 1, m = 1. 
This yields 

y<p[k] = ci k + co 

Therefore 

y$[k + 1 ] = ci(k + 1 ) + co = Cifc + ci + co 


Also 


y<p[k + 2] = ci (k + 2) + c 0 = cifc + 2ci + c 0 


and 


/[*] = 3fc + 5 
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»[*1 =« n [ fc ] + j / 4 *] 

=Si(2) fc + Bi(3) k — 6k — y fc > 0 (9.67) 

To determine arbitrary constants B i and B 2 we set fc = 0 and 1 and substitute the 
initial conditions y[0] = 4, y[l] = 13 to obtain 


4 = Si + B 2 — f "1 Bi = 28 
13 = 2B, + 3B 2 - f J ^ B 2 = ^ 


Therefore 




9n[fc] = 28(2)* - f (3) k 

(9.68) 

and 




y[fc]=_28(2) fc -f(3)' c -6fc-f 

(9.69) 


VnW y^lfc] 


Q Computer Example C9.6 

Solve Example 9.10 using MATLAB. 

%(c96.m) 

Y=[4 13]; Y=Y’; 
k=0:10; k=k’; 
f=[5 8];f=f>; 
for m=l:length(k)-2 

y=5*Y(m+l)-6*Y(m)+f(m-!-l)-5*f(m); 
Y=[Y; y], 

F=3*(m+l)+5;f=[f;F]; 

end 

stem(k,Y) Q 
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A Comment on Initial Conditions 


This method requires auxiliary conditions y [0], j/[l], . . . , y[n - 1] for the reasonk 
explained on p. 142. If we are given the initial conditions y[— 1], y[— 2], . . . , t/[-n], 
we can derive the conditions y [0] , y [ 1 ] , . . . , y[n — 1] using iterative procedure. 


An Exponential Input 


As in the case of continuous-time systems, we can show that for a system 
specified by the equation 


Q[£]j/[fc] = P[E]f[k\ 

the forced response for the exponential input /[fc] = r k is given by 


WW = H[r\r k r^-yt 


The proof follows from the fact that if the input /[fc] = r k , then from Table 9.2 
(Pair 4), y^[fc] = cr k . Therefore 


E'f[k] = /[fc -H] = r k+i = r'r k and P[E\f[k] = P[r]r* 

Ei V<A k \ — V4.[fc + 1] — cr k+ * = cr>r k and Q[E\y[k] = cQ[r]r k 


so that Eq. (9.70) reduces to 


cQ[r]r k = P[r)r k 


which yields c = P[r]/Q[r] = H[r\. 

This result is valid only if r is not a characteristic root of the system. If r is a 
characteristic root, the forced response is ckr k where c is determined by substituting 


y<t>\k] in the system equation and equating coefficients of similar terms on the two 
sides. Observe that the exponential r k includes a wide variety of signals such as 
a constant C, a sinusoid cos (0k + 6), and an exponentially growing or decaying 
sinusoid | 7 | fc cos (0k + 0). 


1. A Constant Input /[fc] = C 

This is a special case of exponential Cr k with r = 1. Therefore, from Eq. 
(9.71), we have 

Pill 

y<t>\k\ = c ~ = c m (9.73) 


2. A Sinusoidal Input 

The input e^ k is an exponential r k with r = e^. Hence 


V4> (k) = H[eV k = 
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Similarly, for the input e~ J/sfc 

v4k\ = H[e~ iP ]e~ i0k 

Consequently, if the input f[k] = cos 0k = \(e j0k + e~ j0k ), 

VM = | {H(e j0 ]e j0k + H[e~i%-^ k } 
Since the two terms on the right-hand side are conjugates 


If 


V 4 >{k\ = Re {H[e^)e^ k } 
H[e i0 \ = \H[e iP ]\e j/ - H ^ 


y+lk J =Re {|/f[e^]| e A/3*+Ztf[<^]) j 
=|R[e^]|cos (0k + lH[e j0 ]) 
Using a similar argument, we can show that for the input 

f[k] =cos (0 k + 8) 

y<t>[k\ = \H{e i0 ]\ cos (0k + 0+ lH(e jp ]) 



(9.74a) 


(9.74b) 


B Example 9.12 

For an LTID system described by the equation 

(E 2 -E + 0.16)j/[fc] = (E + 0.32)/[fc] 
determine the forced response if the input is 


/[*] = cos (2k + |)i x[A] 
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Assessment of the Classical Method 

The remarks in Chapter 2 concerning the classical method for solving differen- 
tial equations (p. 147) also apply to difference equations. 

9.6 System Stability 

Just as in a continuous-time system, we define a discrete-time system to be 
asymptotically stable if, and only if, the zero-input response approaches zero as 
k °°- If the zero-input response grows without bound as k -» oo, the system 
is unstable. If the zero-input response neither approaches zero nor grows without 
bound, but remains within a finite limit as k — * oo, the system is marginally 
stable. In the last case, the zero-input response approaches a constant or oscillates 
with a constant amplitude. Recall that the zero-input response consists of the 
characteristic modes of the system. The mode corresponding to a characteristic 
root 7 is 7 . To be more general, let 7 be complex so that 

7 = \~i\e iP and 7* = \y\ k e^ pk 

Since the magnitude of e ]0k is always unity regardless of the value of k, the magni- 
tude of 7* is |7|*\ Therefore 

if |7| < 1, ~f k -> 0 as k — * 00 

if |7| > 1, 7* — * 00 as k — * 00 

and if | 7 | = 1, | 7 | fc = 1 for all k 
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9.6 System Stability 
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Fig. 9.6 Characteristic roots location and system stability. 

It is clear that a system is asymptotically stable if and only if 
It*| <1 i — 1, 2, • • • ,n 

These results can be grasped more effectively in terms of the location of charac- 
teristic roots in the complex plane. Figure 9.6 shows a circle of unit radius, centered 
at the origin in a complex plane. Our discussion clearly shows that if all charac- 
teristic roots of the system lie inside this circle (unit circle), | 7 i| < 1 for all i and 
the system is asymptotically stable. On the other hand, even if one characteristic 
root lies outside the unit circle, the system is unstable. If none of the characteristic 
roots lie outside the unit circle, but some simple (unrepeated) roots lie on the circle 
itself, the system is marginally stable. If two or more characteristic roots coincide 
on the unit circle (repeated roots), the system is unstable. The reason is that for 
repeated roots, the zero-input response is of the form k r ~ 1 -y k , and if | 7 | = 1, then 
l* r 1 7*l = k r ~ 1 —> 00 as k -» 00 . f Note, however, that repeated roots inside 
the unit circle do not cause instability. Figure 9.7 shows the characteristic modes 
corresponding to characteristic roots at various locations in the complex plane. To 
summarize: 

1. An LTID system is asymptotically stable if and only if all the characteristic 
roots are inside the unit circle. The roots may be simple or repeated. 

2. An LTID system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one root is outside the unit circle; (ii) there are 
repeated roots on the unit circle. 

3. An LTID system is marginally stable if and only if there are no roots outside 
the unit circle and there are some unrepeated roots on the unit circle. 


|If the development of discrete-time systems is parallel to that of continuous-time systems, we 
wonder why the parallel breaks down here. Why, for instance, aren’t LHP and RHP the regions 
demarcating stability and instability? The reason lies in the form of the characteristic modes. In 
continuous-time systems we chose the form of characteristic mode as e A ‘*. In discrete-time systems 
we choose the form (for computational convenience) to be 7*. Had we chosen this form to be e Ai * 
where 7, = e Al , then LHP and RHP (for the location of A,) again would demarcate stability and 
instability. The reason is that if 7 = e , jy( = 1 implies |e A | = 1, and therefore A = jw. This shows 
that the unit circle in 7 plane maps into the imaginary axis in the A plane. 



Fig. 9.7 Characteristic roots location and the corresponding characteristic modes. 
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■ Example 9.13 

Determine whether the systems specified by the following equations are asymptoti- 
cally stable, marginally stable, or unstable. In each case plot the characteristic roots in 
the complex plane. 


(a) y[k + 2] + 2.5y[k + 1] +!/[*] = f[k + 1] - 2 /[*] 

(b) yffc] - y\k - 1] + 0,21y[fc - 2] = 2f[k - 1] + 3/[fc - 2] 

(c) y[k + 3] + 2 y[k + 2] + §y[* + 1] + iy[Jfc] = f\k + 1] 

(d) (E 2 - B + l) 2 y[fc] = (3 E + l)/[fc] 

(a) The characteristic polynomial is 

7 2 + 2.57 + 1 = (7 + 0.5)( 7 + 2) 

The characteristic roots are -0.5 and -2. Because | - 2| > 1 (-2 lies outside the unit 
circle), the system is unstable (Fig. 9.8a). 

(b) The characteristic polynomial is 

7 2 — 7 + 0.21 = ( 7 - 0.3)( 7 - 0.7) 

The characteristic roots are 0.3 and 0.7, both of which lie inside the unit circle. The system 
is asymptotically stable (Fig. 9.8b). 

(c) The characteristic polynomial is 

7 3 + 2 7 2 + §7 + l = (7 + 1)(7 2 + 7 + 5 ) = (7 + 1 ) (7 + 0.5 - j'0.5)( 7 + 0.5 + j0.5) 

The characteristic roots are -1, -0.5 ±.,'0.5 (Fig. 9.8c). One of the characteristic roots 
is on the unit circle and the remaining two roots are inside the unit circle. The system is 
marginally stable. 

(d) The characteristic polynomial is 

(7 2 -7 + l) 2 =(7-§->#) 2 (7-i+i#) 2 

The characteristic roots are ± ± = le ±j § repeated twice, and they lie on the unit 

circle (Fig. 9.8d). The system is unstable. H 

A Exercise E9.13 

Fmd and sketch the location in the complex plane of the characteristic roots of the system 
specmed by the following equation: 

{E + 1 ){E 2 + 6 E + 25)y[fc] = 3 Ef[k] 

Is this a stable, unstable, or marginally stable system? Answer: unstable. v 

A Exercise E9.14 

Repeat Prob. E9.13 for 

(E - 1) 2 (£ + 0.5)y[fc] = (E 2 + 2E + 3)/[Jfc) 

Answer: unstable. 

9.6-1 System Response to Bounded Inputs 

As in the case of continuous-time systems, asymptotically stable discrete-time 
systems have the property that every bounded input produces a bounded output. 



Fig. 9.8 Location of characteristic roots for systems in Example 9.13. 

In contrast, for a marginally stable and unstable system it is possible to find a 
bounded input that produces unbounded output. To prove this result we recall 
that 


and 


y[fc] =M fc ] * /[*] 

oo 

= h[m]f\k — m] 

m= — oo 


|y[ fc ]l = 


oo 

y: h[m]f[k - m] 
m =— oo 


oo 

< |h[m]||/[fc-m]| 

m=— oo 


If / [fc] is bounded, then \f[k — m]| < K\ < oo, and 

OO 

|y[ fc ]l < Ki ^2 |h[m]| 
m=— oo 

Clearly the output is bounded if the summation on the right-hand side is bounded; 
that is, if 
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OO 

E i ft wi<^2 < oo (9.75) 

k =— oo 

For an asymptotically stable system 

h[fc] = (c i7j + c 2 72 + • • • + c n 7*)u[fc] 

with the characteristic roots 7i , 72 , ■ ■ • 7n lying within the unit circle. Under these 
conditions h[fc] satisfies Eq. (9.75).f Therefore, the response of an asymptotically 
stable system to a bounded input is also bounded. Moreover, we can show that 
for an unstable or marginally stable system, the response is unbounded for some 
bounded input. As seen in Sec. 2.6-1, these results lead to the formulation of an 
alternate definition of system stability. A system is said to be stable in the sense of 
having bounded output for every bounded input (BIBO stability) if and only if its 
impulse response h[k) satisfies Eq. (9.75). Condition (9.75) is sufficient for a system 
to produce bounded output for any bounded input. It is relatively easy to show 
that it is also a necessary condition; that is, for a system that violates (9.75), there 
exists a bounded input that produces unbounded output (see Prob. 9.6-2). Note 
that an asymptotically stable system is always BIBO-stable.f 

9.6-2 Intuitive Insights Into System Behavior 

The intuitive insights into the behavior of continuous-time systems and their 
qualitative proofs, discussed in Sec. 2.7, also apply to discrete-time systems. For 
this reason, we shall merely mention here some of these insights without discussion 
or proof. The interested reader should read Sec. 2.7 for more explanation. 

The system s behavior is strongly influenced by the characteristic roots (or 
modes) of the system. The system responds strongly to input signals similar to its 
characteristic modes, and responds poorly to inputs very different from its charac- 
teristic modes. In fact, when the input is a characteristic mode of the system, the 
response goes to infinity provided that the mode is a nondecaying signal. This is 
the resonance phenomenon. The width of an impulse response A[fc] indicates the 
response time (time required to respond fully to an input) of the system. It is the 
time constant of the system.) Discrete-time pulses are generally dispersed when 

fThis conclusion follows from the fact that (see Sec. B.7-4) 

OO °° 

E l7,*M*] = Ebt| fc = rZT7| [7,1 < 1 

fc=-oo fc = 0 l7t| 

Therefore, if | 7 t| < 1 for i = 1, 2, . . . , n, 

OO n 

E w*!l < Erri < 00 

Although we have assumed all the roots to be distinct in this derivation, it is also valid for repeated 
roots provided that they lie inside the unit circle. 

|The converse is not true. See footnote on p. 152. 

fThis part of the discussion applies to systems with impulse response h[fcl that is a mostly positive 
(or mostly negative) pulse. 
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passed through a discrete-time system. The amount of dispersion (or spreading 
out) is equal to the system time constant (or width of h[fc]). 

9.7 Appendix 9.1: Determining the Impulse Response 

For a discrete-time system specified by Eq. (9.27), we have demonstrated that 


h[fc] = Ao6[fc] + j/n [fc]u [fc] 


We now show that 


. u 

An — 


To prove this point, we substitute Eq. (9.76) in Eq. (9.28) to obtain 

Q[E] (A 0 «[fc] + y„[fc]u[fc]) = T>[£7]5[fc] 

Because y n [k]u[l:] is a sum of characteristic modes,) [see Eq. (9.12a)] 
Q[E) (j/ n [fc]u[k]) =0 k >0 
Equation (9.78) now reduces to 

AoC?[E]<5[fc] = P[£],5[*:] k>0 


Ao(6[i + n] + o n _i£[k + n — 1] + ■ ■ • + a, 6\k + 1] + ao6[fc]) = f> n <5[k + n] 

+ + n — 1] -f- ■ • • -f- iq6[k + 1] -b &o6[fc] fc > 0 

If we set k = 0 in this equation and recognize that A [0] = 1 and 6[m] = 0 when 
m / 0, all but the last terms vanish on both sides, yielding 

Aoao = bo 


a fc ° 

A 0 = — 
a o 

A Special Case: ao = 0 

In this case Ag = ^ becomes indeterminate. The procedure has to be modified 
slightly. When a 0 = 0, Q[E] can be expressed as EQ[E], and Eq. (9.28) can be 
expressed as 

EQ[E]h[k] = P[E]S[k] 

If we recognize that -g is a delay operator, this equation can be rearranged as 
fNote that 

Q\E] (yn(kl) = 0 

for all k. But if we restrict the mode terms to be causal, the equation is valid only for k > 0; that 

is, 

Q[E] (yn[fc)u[fe]) = 0 k > 0 
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C?[E]fc[fc] = P[E] (i«[fc]) = P\E\6[k - 1] 

In this case the input vanishes not for k > 1, but for k > 2. Therefore, the response 
consists not only of the zero-input term and an impulse A 0 <5[kj (at k = 0), but also 
of an impulse A x 6[k - 1] (at k = 1). Therefore 

h[fc] = -do£[fc] + A\6[k — 1] + y n [k}u\k] 

We can determine the unknowns Ao, A x , and the n coefficients in y n [1] from the 
n -+ 2 number of initial values /i[0], /i[l], ■ ■ • , h[n + 1], determined as usual from the 
iterative solution of the equation Q[£]h[A;] = P[E]5[k]. Similarly, if ao = aj = 0, 
we need to use the form /t[k] = A 0 <5[k] + Afy[A: - 1] + A 2 6[k - 2] + y n [k]u{k]. The 
n + 3 unknown constants are determined from the n + 3 values h[0], /i[l], ■ . . , h[n + 
1], h[n + 2], determined iteratively, and so on. 

9.8 Summary 

This chapter discusses time-domain analysis of LTID (linear, time-invariant, 
discrete-time) systems. The analysis is parallel to that of LTIC systems, with some 
minor differences. Discrete-time systems are described by difference equations. For 
an nth-order system, n auxiliary conditions must be specified for a unique solution 
to an input starting at k = 0. Characteristic modes are discrete-time exponentials 
of the form y k corresponding to an unrepeated root y, and the modes are of the 
form k l y k corresponding to a repeated root 7. 

The unit impulse function <5 [A] is a sequence of a single number of unit value 
at k — 0. The unit impulse response h[fcj of a discrete-time system is a linear 
combination of its characteristic modes. f 

The zero-state response (response due to external input) of a linear system 
is obtained by breaking the input into impulse components and then adding the 
system responses to all the impulse components. The sum of the system responses 
to the impulse components is in the form of a sum, known as the convolution sum, 
whose structure and properties are similar to the convolution integral. The system 
response is obtained as the convolution sum of the input / [A] with the system’s 
impulse response h[fc]. Therefore, the knowledge of the system’s impulse response 
allows us to determine the system response to any arbitrary input. 

LTID systems have a very special relationship to the everlasting exponential 
signal z k because the response of an LTID system to such an input signal is the 
same signal within a multiplicative constant. The response of an LTID system to 
the everlasting exponential input z k is H [z]z k , where H[z] is the transfer function 
of the system. 

The stability criterion in terms of the location of characteristic roots of the 
system can be summarized as follows: 

1 . An L 1 ID system is asymptotically stable if and only if all the characteristic 

roots are inside the unit circle. The roots may be repeated or unrepeated. 

2. An LTID system is unstable if and only if either one or both of the following 


conditions exist: (i) at least one root is outside the unit circle, (ii) there are 
repeated roots on the unit circle. 

3. An LTID system is marginally stable if and only if there are no roots outside 
the unit circle, and there are some unrepeated roots on the unit circle. 

According to an alternate definition of stability — the bounded-input bounded- 
output (BIBO) stability — a system is stable if and only if every bounded input 
produces a bounded output. Otherwise the system is unstable. An asymptotically 
stable system is always BIBO-stable. The converse is not necessarily true. 

Difference equations of LTID systems can also be solved by the classical method, 
where the response is obtained as a sum of natural and forced responses. These are 
not the same as the zero-input and zero-state components, although they satisfy the 
same equations, respectively. Although simple, this method suffers from the fact 
that it is applicable to a restricted class of input signals, and the system response 
cannot be expressed as an explicit function of the input. These limitations make it 
useless in the theoretical study of systems. 

Problems 

9.1- 1 Solve iteratively (first three terms only): 

(a) y[k + 1] - 0.5y[fc] = 0, with y[— 1] = 10 

(b) y[fc + 1] + 2 y [fc] = f[k + 1], with f[k] — e~ k u\k\ and y[ — 1) = 0 

9.1- 2 Solve the following equation iteratively (first three terms only): 

y(fc] - 0.6y[k - 1] - 0.16y[k - 2] = 0 with y[— 1] = -25, y[— 2] = 0 

9.1- 3 Solve iteratively the second-order difference Eq. (8.26b) in chapter 8 (first three terms 

only), assuming y[ — 1] = y[ — 2] = 0 and f[k] — 100u[fc]. 

9.1- 4 Solve the following equation iteratively (first three terms only): 

y\k + 2] + 3 y[k + 1] + 2y[k] = f[k + 2] + 3 J\k + 1) + 3/[fc) 
with f\k] = (3) k u[k], y [ — 1] = 3, and y [ — 2] = 2 

9.1- 5 Repeat Prob. 9.1-4 if 

y[fc] + 2y[fc - 1] + y[fc - 2] = 2f[k] - f[k - 1) 
with f[k] = (3) -t u[fc],y[— 1) = 2, and y[ — 2] = 3. 

9.2- 1 Solve 

y[k + 2] + 3 y{k + 1] + 2y[fc] = 0 if y[-l] = 0, y[-2] = 1 

9.2- 2 Solve 

y[k + 2] + 2y[k + 1] + y[k] = 0 if y[-l] = 1, y[-2] = 1 

9.2- 3 Solve 

y[k + 2] - 2y[fe + 1] + 2 y[k] = 0 if y[-l] = 1, y[-2] = 0 


(There is a possibility of an impulse <5[fcJ in addition to characteristic modes. 


9.2-4 Find «[k], the voltage at the fcth node of the resistive ladder depicted in Fig. P8.5-5 
in Chapter 8, if V = 100 volts and a = 2. 
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Hint: The difference equation for v\k] is given in Prob. 8.4-5. The auxiliary conditions 
are u[0] = 100 and u[N] = 0. 

9 . 3-1 Find the unit impulse response h[k] of a system specified by the equation 

y[k + 1] + 2y[k] = f[k] 


h[fc] = (3) k cos(f k — 0.5)it[fc] 

9.4-6 Find the total response of a system specified by the equation 


9.3- 2 Repeat Prob. 9.3-1 if 

y[k + 1] + 2y[k] = f[k + 1] 

9.3- 3 Repeat Prob. 9.3-1 if 

( E 2 -6 E + 9 )y[k] = Ef[k] 

9.3- 4 Repeat Prob. 9.3-1 if 

y[fc] - 6 y[k - 1] + 25 y[k - 2} = 2 f[k] - 4 /[fc - 1] 

9.3- 5 For the general nth-order difference Eq. (9.9), if 

oo = ai = aa = • ■ • = o n -i = 0 

the resulting equation is called a nonrecursive difference equation. 

(a) Show that the impulse response of a system described by this equation is 

h[k\ = W[fc] + kn-i«[fc - 1) + ' ' • + Ml* - n + 1] + b 0 f[k - n] 

Hint: Express the system equation in delay-operator form. 

(b) Find the impulse response of a nonrecursive LT1D system described by the equa- 
tion 

y [k] = 3 f[k] - 5/[fc - 1] - 2 f[k - 3] 

Observe that the impulse response has only a finite (n) number of nonzero elements. 
For this reason, such systems are called finite impulse response (FIR) systems. 
For a general recursive case [Eq. (9.9)], the impulse response has an infinite number 
of nonzero elements, and such systems are called infinite impulse response (HR) 
systems. 

9.4- 1 Find the (zero-state) response y[fc] of an LTID system whose unit impulse response 

is 

h[k] = (-2) k u[fc] 

and the input is /[fc] = e~ k u[k], 

9.4- 2 Repeat Prob. 9.4-1 if 

h[k\ = ±[«[k] - (-2 ) k \n[k] 

9.4- 3 Repeat Prob. 9.4-1 if the input f[k] = (3) k+2 u[fc], and 

h[k] = [(2) fc + 3(— 5) k ]tt[fc] 

9.4- 4 Repeat Prob. 9.4-1 if the input f[k] = (3) _k u[fc], and 

h[k] = 3fc(2) k u[fc] 

9.4- 5 Repeat Prob. 9.4-1 if the input /[fc] = (2) k u[fc], and 


y[k + 1] + 2 y[k] = f[k + 1] 


if ?/[ — 1] = 10, and the input f[k] = e k u[k]. 

9.4- 7 Repeat Prob. 9.4-1 if the impulse response h[fc] = (0.5)*u[fc], and the input f[k] is 

(a) 2 k u[k] (b)2 (fc “ 3) u[fc] (c) 2 k u[k — 2]. 

Hint: You may need to use the shift property (9.46) of the convolution. 

9.4- 8 In the savings account problem described in Example 8.5 (chapter 8), a person de- 

posits $500 at the beginning of every month, starting at k = 0 with the exception at 
k = 4, when instead of depositing $500, she withdraws $1000. Find y[k] if the interest 
rate is 1% per month (r = 0.01). 

Hint: Because the deposit starts at k = 0, the initial condition y [ — 1] = 0. Withdrawal 
is a deposit of negative amount. 

9.4- 9 To pay off a loan of M dollars in N payments using a fixed monthly payment of P 

dollars, show that 


r(l 4- r) 

(1 + r) N — 1 


where r is the interest rate per dollar per month. 

Hint: This problem can be modeled by Eq. (8.24) with the payments of P dollars 
starting at k = 1. The problem can be approached in two ways: (1) Consider the 
loan as the initial condition yo[0] = -M, and the input f[k] = Pu[k — 1]. The 
loan balance is the sum of the zero-input component (due to the initial condition) 
and the zero-state component h[k] * f[k]. (2) In the second approach the loan is 
considered as an input — M at fc = 0; that is, —M6\k]. The total input is, therefore, 
f[k] = —M6[k\ + Pu[k — 1], and the loan balance is h[k] * /[fc]. Because the loan is 
paid off in N payments, set y [TV] = 0. 

9.4- 10 A person receives an automobile loan of $10,000 from a bank at the interest rate of 

1.5% per month. His monthly payment is $500, with the first payment due one month 
after he receives the loan. Compute the number of payments required to pay off the 
loan. Note that the last payment may not be exactly $500. 

Hint: Follow the procedure in Prob. 9.4-9 to determine the balance y[fc]. To determine 
N, the number of payments, set y[N] = 0. In general, N will not be an integer. The 
number of payments K is the largest integer < N. The residual payment is |y[i£]|. 

9.4- 11 Using the sliding-tape algorithm, show that 


(a) u[k] * u[fc] = (fc + l)u[fc] 

(b) (u[fc] — u[k — m]) * u[k] = (fc 4- l)u[fc] — (fc — m + l)u[fc — m] 
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(b) 

Fig. P9.4-14 


9.4- 12 Using the sliding-tape algorithm, find f[k] * <?[fc] for the signals shown in Fig. P9.4-12. 

9.4- 13 Repeat Prob. 9.4-12 for the signals shown in Fig. P9.4-13. 

9.4- 14 Repeat Prob. 9.4-12 for the signals depicted in Fig. P9.4-14. 

9.4- 15 The convolution sum in Eq. (9.48) can be expressed in a matrix form as 



or 


y = Hf 
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and 

f = H _1 y 

Knowing h[h] and the output y[fc], we can determine the input f[k]. This operation 
is the reverse of the convolution and is known as the deconvolution. Moreover, 
knowing f[k] and y[k] y we can determine MM* This can be done by expressing the 
above matrix equation as k + 1 simultaneous equations in terms of k 4* 1 unknowns 
MO], Ml]» • • • > MM* These equations can readily be solved iteratively. Thus, we can 
synthesize a system that yields a certain output y[fc] for a given input f[k]. 

(a) Design a system (that is, determine MM ) that will yield the output sequence (8, 
12, 14, 15, 15.5, 15.75, • • •) for the input sequence (1, 1, 1, 1, 1, 1, • • •). 

(b) For a system with the impulse response sequence (1, 2, 4, • • ■), the output sequence 
was (1, 7/3, 43/9, • • •). Determine the input sequence. 

9.4-16 The sliding- tape method is conceptually quite valuable in understanding the convolu- 
tion mechanism. Numerical convolution can also be performed from the arrays using 
the sets /[ 0], /[l], /[ 2], . . ., and g[0], <?[1], g[2], . . ., as depicted in Fig. P9.4-16. The 
ij th element (element in the zth row and jfth column) is given by We add the 

elements of the array along its diagonals to produce c[fc] = f[k] * g[k]. For example, if 
we sum the elements corresponding to the first diagonal of the array, we obtain c[0] . 
Similarly, if we sum along the second diagonal, we obtain c[l], and so on. Draw the 
array for the signals f[k] and g[k] in Example 9.9, and find f[k] * g[k]. 


\n*i 


c [0] 

c m c 12] • - 

* t*)\ 

/[ 0] 

/m / fi) 



« [0] 

/ IP-)*' [0] 

/i.u*[0] fii)gio] 

/13]*[0) 


g til 

/ (pi* 1 1 1 

/ l.M* in /L2J*[1] 

/[3]g|IJ 


* [2] 

/ [0)*-[2) 

/ HI* [21 / [2Jg [2] 

/13)*[2] 


* [3] 

/I0]s|3] 

/m*[3] / [2]f (3] 

/(3]*[3] 


Fig. P9.4-16 


9.4-17 Using Eq. (9.58), show that the transfer function of a unit delay is H[z] = \jz. 

9.5- 1 Using the classical method, solve 

y\k + 1] 4- 2 y[k] = f[k + 1] 

with the input f[k] = e“ fc u[M> and the auxiliary condition y[0] = 1. 

9.5- 2 Using the classical method, solve 


y\k] + 2 y[k - 1) = f[k - 1] 
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with the input /[fc] = e fe u[fc] and the auxiliary condition y[— 1] = 0. Hint: You will 
have to determine the auxiliary condition y[ 0] using the iterative method. 

9.5- 3 (a) Using the classical method, solve 

y[k + 2] + 3 y[k + 1] + 2 y[k] = f[k 4- 2] 4- 3/[* 4- 1] 4- 3 /[fc] 

with the input /[fc] = (3) fc and the auxiliary conditions y[0] = 1, j/[l] = 3. 

(b) Repeat (a) if the auxiliary conditions are y[— 1] = y[— 2] = 1. Hint: Using the 
iterative method, determine y[ 0] and y[l], 

9.5- 4 Using the classical method, solve 

y[k\ + 2y[fc - 1] 4- y[k - 2] = 2 /(fc] - f[k - 1] 
with the input f[k] = 3~ fc u[fc] and the auxiliary conditions y[ 0] = 2 and y[l] = 

9.5- 5 Using the classical method, solve 

(£ 2 -£ + 0.16)y[fe] = £/[*:] 

with the input /[fc] = (0.2) fc u[fcj and the auxiliary conditions y [0] = 1, y [1] = 2. Hint: 
The input is a natural mode of the system. 

9.5- 6 Using the classical method, solve 

(E 2 - B + 0.16)y[k] = £/[*:] 

with the input /[fc] = cos(ly + § )u[fc] and the initial conditions y[— 1] = y\~2\ = 0. 
Hint: Find y[0] and y [1| iteratively. 

9.6- 1 Each of the following equations specifies an LTID system. Determine whether these 

systems are asymptotically stable, unstable, or marginally stable. 

(a) y[k + 2] + 0.6y[fc + 1] - 0.16y[fc] = f{k + 1] - 2/[fe] 

(b) {E 2 + 1 ){E 2 + E + l)y[fc] = Ef[k] 

(c) (£-l) 2 (E + A)y[fc] = (E + 2)/[fc] 

(d) y[fc] + 2y[fc - 1] + 0.96y[fc - 2] = 2 f{k - 1] + 3 }{k - 3] 

(e) (E 2 - 1)(E 2 + l)y[fc] = /[fc] 

9.6- 2 In Sec. 9.6 we showed that for BIBO stability in an LTID system, it is sufficient for 

its impulse response h[fc] to satisfy Eq. (9.75). Show that this is also a necessary 
condition for the system to be BIBO-stable. In other words, show that if Eq. (9.75) 
is not satisfied, there exists a bounded input that produces unbounded output. 

Hint: Assume that a system exists for which h[fc] violates Eq. (9.75), yet its output 
is bounded for every bounded input. Establish contradiction in this statement by 
considering an input /[fc] defined by /[fci - m] = 1 when h[m] > 0 and /[fci — m] = 
-1 when h[m] < 0, where fci is some fixed integer. 

9.6- 3 Show that a marginally stable system is BIBO-unstable. Verify your result by consid- 

ering a system with characteristic roots on the unit circle and show that for the input 
of the form of the natural mode (which is bounded), the response is unbounded. 



Fourier Analysis of 
Discrete-Time Signals 


In Chapters 3, 4, and 6, we studied the ways of representing a continuous-time 
signal as a sum of sinusoids or exponentials. In this chapter we shall discuss similar 
development for discrete-time signals. Our approach is parallel to that used for 
continuous-time signals. We first represent a periodic / [fc] as a Fourier series formed 
by a discrete-time exponential (or sinusoid) and its harmonics. Later we extend this 
representation to an aperiodic signal /[fc] by considering /[fc] as a limiting case of 
a periodic signal with the period approaching infinity. 

10.1 Periodic Signal Representation by Discrete-Time 
Fourier Series (DTFS) 

A periodic signal of period A o is called an Ao-periodic signal. Figure 8.9 shows 
an example of a periodic signal of period 6. A continuous-time periodic signal of 
period To can be represented as a trigonometric Fourier series consisting of a si- 
nusoid of the fundamental frequency u>o = and all its harmonics (sinusoids of 
frequencies that are integral multiples of uio). The exponential form of the Fourier 
series consists of exponentials e j0t , e ± - 7 “' ot , e ± f 2u '° t , e ±j3w — For a parallel de- 
velopment of the discrete time case, recall that the frequency of a sinusoid of period 
N 0 is fi 0 = 27r/Ao- Hence, an Ao-periodic discrete- time signal /[fc] can be rep- 
resented by a discrete-time Fourier series with fundamental frequency f2 0 = jjjj 
and its harmonics. As in the continuous-time case, we may use a trigonometric or 
an exponential form of the Fourier series. Because of its compactness and ease of 
mathematical manipulations, the exponential form is preferable to the trigonomet- 
ric. For this reason we shall bypass the trigonometric form and go directly to the 
exponential form of the discrete-time Fourier series. 

The exponential Fourier series consists of the exponentials e^ ofc , e ±]il ° k , e ±J 2n ofc, 
. . . , e ±:, " nofc , . . . , and so on. There would be an infinite number of harmonics, 


618 


10 Fourier Analysis of Discrete-Time Signals 


except for the property proved in Sec. 8.2: that discrete-time exponentials whose 
frequencies are separated by 2 tt (or integral multiples of 27r) are identical because 


The consequence of this result is that the rth harmonic is identical to the (r + Ao)th 
harmonic. To demonstrate this, let g n denote the nth harmonic e jnn ° k . Then 

g r+No = e j ( r+N ° )Clok = e l(rihk+2^k) = £ jrSi 0 k _ ^ ( 10 .2) 


9r — 9r+No 9r+2No — 9r+mNo m > integer (10.3) 

Thus, the first harmonic is identical to the (Ao + l)st harmonic, the second harmonic 
is identical to the (Ao+2)nd harmonic, and so on. In other words, there are only Ao 
independent harmonics, and they range over an interval 2-k (because the harmonics 
are separated by ffo = We may choose these No independent harmonics as 
e jrSl 0 k Qver 0 < r < No - 1, or over -1 < r < Ao — 2, or over 1 < r < Ao, or over 
auiy other suitable choice for that matter. Every one of these sets will have the same 
harmonics, although in different order. Let us take the first choice (0 < r < No - 1). 
This choice corresponds to exponentials c ,rSl ° k for r = 0, 1, 2, . . ., No — 1. The 
Fourier series for an Ao-periodic signal f[k] consists of only these No harmonics, 
and can be expressed as 


/[fc] = Y V r e^ k n 0 = 


To compute coefficients V r in the Fourier series (10.4), we multiply both sides of 
(10.4) by e ~i mSl ok an( j sura over f, f rom fc = o to (No - 1). 

JV 0 -1 N 0 -l N 0 -l 

Y f[k]e- jmilok = Y Y ®re J ' (r ' m)nofc (10.5) 

fc= 0 k=0 r=0 

The right-hand sum, after interchanging the order of summation, results in 
No — 1 pVo-1 

Y D r e i(r-m)n 0 k ( 10 .6) 

r=0 _ fc— 0 

The inner sum, according to Eq. (5.43), is zero for all values of r / m. It is nonzero 
with a value No only when r = m. This fact means the outside sum has only one 
term V m No (corresponding to r = m). Therefore, the right-hand side of Eq. (10.5) 
is equal to V m No, and 

N 0 -l 

E JW- imUok = V m N 0 

k= 0 

and 

, No-l 

= tt E m*- imaak ( 10 - 7 ) 

N ° 
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We now have a discrete-time Fourier series (DTFS) representation of an Ao-periodic 
signal / [fc] as 

JVo-l 

/[fc] = Y V T e jrSl ° k (10.8) 

r= 0 

where 

i ^ 0_1 o_ 

Dr = ^ Y rtkV~ irnok = jt ( 10 ' 9) 

No No 

Observe that DTFS equations (10.8) and (10.9) are identical (within a scaling con- 
stant) to the DFT equations (5.18b) and (5.18a)4 Therefore, we can compute the 
DTFS coefficients using the efficient FFT algorithm. 

10.1-1 Fourier Spectra of a Periodic Signal /[fc] 

The Fourier series consists of No components 

Vo, T> x e in ° k , V 2 e j2Clok , V No ^ie j( - No ~ 1){t ° k 

The frequencies of these components are 0, flo, 2f!o, . . ., (No — l)Do where fio = 
2 tt/A 0 . The amount of the rth harmonic is V r . We can plot this amount V T (the 
Fourier coefficient) as a function of Cl. Such a plot, called the Fourier spectrum of 
/[fc], gives us, at a glance, the graphical picture of the amounts of various harmonics 
of /[fc]. 

In general, the Fourier coefficients V T are complex, and they can be represented 
in the polar form as 

V r = \V r \e iiv ' (10.10) 

The plot of |D r | vs. Cl is called the amplitude spectrum and that of LV r vs. Cl is 
called the angle (or phase) spectrum. These two plots together are the frequency 
spectra of /[fc]. Knowing these spectra, we can reconstruct or synthesize /[fc] ac- 
cording to Eq. (10.8). Therefore, the Fourier (or frequency) spectra, which are an 
alternative way of describing a signal /[fc], are in every way equivalent (in terms 
of the information) to the plot of /[fc] as a function of fc. The Fourier spectra of 
a signal constitute the frequency-domain description of /[fc], in contrast to the 
time-domain description, where /[fc] is specified as a function of time (fc). 

The results are very similar to the representation of a continuous-time periodic 
signal by an exponential Fourier series except that, generally, the continuous-time 
signal spectrum bandwidth is infinite, and consists of an infinite number of expo- 
nential components (harmonics). The spectrum of the discrete-time periodic signal, 
in contrast, is bandlimited and has at most Ao components. 

Periodic Extension of Fourier Spectrum 

Note that if <t>[r] is an A 0 -periodic function of r, then 

No-l 

Y = E (1011) 

r=0 r=<No> 


flf we let f\k \ = Nofk and V r = F r , Eqs. (10.8) and (10.9) are identical to Eqs. (5.18b) and 
(5.18a), respectively. 
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where r —<N o> indicates summation over any Nq consecutive values of r. This 
follows because the right-hand side of Eq. (10.11) is the sum of all the N 0 consecutive 
values of 4>\r}. Because <f>[r] is periodic, this sum must be the same regardless of 
where we start the first term. Now e ~ lrn ° k is No-periodic because 

e -jrSl 0 (k+No) _ e ~ jrtt 0 k e —j2*r _ —jrSl 0 k 

Therefore, if f[k] is No-periodic, /[fc]e -jrn °* : is also No-periodic. Hence, from Eq. 
(10.9) it follows that V r is also N 0 -periodic, as is V r e^ rClak . Now, because of prop- 
erty (10.11), we can express Eqs. (10.8) and (10.9) as 

f[k\ = Y V r e iT ^ k 

r=<N 0 > 

and 

Vr = j-Y me- jrn ° k 

u k—<No> 

If we plot V r for all values of r (rather than only 0 < r < No — 1), then 
the spectrum V r is N 0 -periodic. Moreover, Eq. (10.12) shows that f{k\ can be 
synthesized by not only the No exponentials corresponding to 0 < r < No — 1, 
but by any successive N 0 exponentials in this spectrum, starting at any value of r 
(positive or negative). For this reason, it is customary to show the spectrum V r for 
all values of r (not just over the interval 0 < r < N 0 - 1). Yet we must remember 
that to synthesize /[fc] from this spectrum, we need to add only No consecutive 
components. 

The spectral components V r are separated by the frequency f! 0 = , and there 

are a total of No components repeating periodically along the SI axis. Thus, on the 
frequency scale Si, V r repeats every 2x intervals. Equations (10.12) and (10.13) 
show that both f[k] and its spectrum V, are periodic and both have exactly the 
same number of components (N 0 ) over one period. The period of f[k\ is No and 
that of V r is 2x radians. 

Equation (10.13) shows that V T is complex in general, and is the conjugate 
of V r if f[k] is real. Thus 

\V T \ = \V- r \ and lV r — -ZZ>_ r (10.14) 

so that the amplitude spectrum |X> r | is an even function , and LV r is an odd function 
of r (or fi). All these concepts will be clarified by the examples to follow. 

■ Example 10.1 

Find the discrete-time Fourier series (DTFS) for f[k] = sin 0.1x1: (Fig. 10.1a). Sketch 
the amplitude and phase spectra. 

In this case the sinusoid sin O.lxfc is periodic because Q = T. is a rational number 
and the period No is [see Eq. (8.9b)] 

N° = m(|)= m (^)= 2 ° m 

The smallest value of m that makes 20m an integer is m = 1. Therefore, the period 
No = 20, so that Do = = O.lx, and from Eq. (10.12) 


( 10 . 12 ) 

(10.13) 





Fig. 10.1 Discrete-time sinusoid sin 0.1x1: and its Fourier spectra. 


/[!]= Y V r e m * rk 

r=< 20> 

where the sum is performed over any 20 consecutive values of r. We shall select the range 
— 10 < r < 10 (values of r from -10 to 9). This choice corresponds to synthesizing f[k] 
using the spectral components in the fundamental frequency range ( — ir < fi < tt). Thus, 


/m= E 

r= — 10 


T> r e ial * rk 


where, according to Eq. (10.13), 


V r 


20 


9 

Y sin 0.1xle - -’ o llrrfc 

fc= — 10 


_L — /J0.1rt 

20 2 j ' 

fc~— 10 


— e ~i 0lnk ) 


jO.lTrrfc 


l 

40j 


‘ 9 

Y | e J0 1xfc(l-r) 
_ fc = — 10 


9 

c -j'0.1irfc(l+r) 

fc --10 



622 


10 Fourier Analysis of Discrete-Time Signals 


In these sums, r takes on all values between —10 and 9. From Eq. (5.43) it follows that 
the first sum on the right-hand side is zero for all values of r except r = 1, when the sum 
is equal to No = 20. Similarly, the second sum is zero for all values of r except r = — 1, 
when it is equal to No = 20. Therefore 

,, 1 , ^ 1 

T>i = — and T>_i = - — 

2j 2j 

and all other coefficients are zero. The corresponding Fourier series is given by 


/[*] = sin 0. Ink = £ (e j01irk - e~ j01 * k ) (10. 15) 

Here the fundamental frequency Qo = 0.17T, and there are only two nonzero components: 


®i = £ = 


Therefore 


o-i = = Je*"* 

|Pi| = |X»_i| = | 


ZDr = -§ and ZT>_i = § 

Figures 10.1b and c shows the sketch of D r for the interval (-10 < r < 10). According 
to Eq. (10.15a), there are only two components corresponding to r — 1 and -1. The 
remaining 18 coefficients are zero. The rth component T> r is the amplitude of the frequency 
rClo = O.lrrr. Therefore, the frequency interval corresponding to —10 < r < 10 is -ir < 
Cl < zr, as depicted in Figs. 10.1b and c. This spectrum in the interval -10 < r < 10 (or 
—ir < Cl < rr) is sufficient to specify the frequency-domain description (Fourier series), and 
we can synthesize /[fc] by adding these spectral components. Because of the periodicity 
property discussed in Sec. 10.1-1, the spectrum V T is a periodic function of r with period 
No = 20. For this reason, we repeat the spectrum with period No = 20 (or Cl = 2zr), as 
illustrated in Figs. 10.1b and c, which are periodic extensions of the spectrum in the range 
— 10 < r < 10. Observe that the amplitude spectrum is an even function and the angle or 
phase spectrum is an odd function of r (or Cl) as expected. 

The result (10.15) is a trigonometric identity, and could have been obtained immedi- 
ately without the formality of finding the Fourier coefficients. We have intentionally chosen 
this trivial example to introduce the reader gently to the new concept of the discrete-time 
Fourier series and its periodic nature. The Fourier series is a way of expressing a periodic 
signal /[fc] in terms of exponentials of the form e* ° fc and its harmonics. The result in 
Eq. (10.15) is merely a statement of the (obvious) fact that sin 0.l7rfc can be expressed as 
a sum of two exponentials e j0l ~ rk and e 

Because of the periodicity property of the discrete-time exponentials e J,1! , the 
Fourier series components can be selected in any range of length No = 20 (or Cl = 2rr). 
For example, if we select the frequency range 0 < fi < 2rr (or 0 < r < 20), we obtain the 
Fourier series as 

/[fc] = sin O.lt rfc = ^ (e j01lrfc - e - * 1 - 9 ”* ) (10.16) 

2 j K ' 

This series is equivalent to that in Eq. (10.15) because, as seen in Sec. 8.2, the two expo- 
nentials e^ 1-9irfc and e“ ,01irfc are identical. 

We could have selected the spectrum over any other range of width U = 2n in Figs. 
10.1b and c as a valid discrete-time Fourier series. The reader may satisfy himself by 
proving that such a spectrum starting anywhere (and of width Q, = 2n) is equivalent to 
the same two components on the right-hand side of Eq. (10.15). B 


10.1 Periodic Signal Representation by Discrete-Time Fourier Series (DTFS) 623 


A Exercise E10.1 

FYom the spectrum in Fig. 10.1 write the Fourier series corresponding to the interval — 10 > 
r > —30 (or — n > f 1 > — 37t). Show that this Fourier is equivalent to that in Eq. (10.15). V 

A Exercise E10.2 

Find the period and the DTFS for 

f[k] = 4 cos 0.27rfc + 6 sin 0.57rfc 

over the interval 0 < r < 19. Use Eq. (10.9) to compute X> r . 

Answer: 

No = 20, and /[fc] = 2e j0 - 2ltk + (3e~^/ 2 )e^ 0 - 5Tk + (3e” r/2 )^' 1 ' 5,rfc + 2e’ 1 ' 8,rfe V 



Fig. 10.2 Periodic sampled gate pulse and its Fourier spectrum. 


M Example 10.2 

Find the discrete-time Fourier series for the periodic sampled gate function shown in 
Fig. 10.2a. 

In this case Ao = 32andS1o = |§ = 'fg. Therefore 
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This is a geometric progression with a common ratio e i® r . Therefore, [see Sec. (B.7-4)] 
Dr = ; 


, r _,-5 *r 4 XT 

1 \e 3 - e 


32 


e -3TC - 1 



r a 4,5at- 

1 44-^1 

e 3 i6 

e 1 >6 



f • 0.5irr 

■ O.Sicr 

e 3 le 

e 1 is 

— e J is 


_ f±) sin (frfO 

V32 ) sin (2#^) 


( 1 ^ sin(4.5rf!o) n _ » 

_ l32j sin(0.5rfi o ) 16 

This spectrum (with its periodic extension) is depicted in Fig. 10.2b. f 


(10.19) 


Q Computer Example C10.1 

Do Example 10.2 using MATLAB. 

N0=32;k=0:N0-l; 

f=[ones(l,5) zeros(l,23) ones(l,4)]; 

Fr=l/32*fft(f); 

r=k; 

stem(k,Fr),grid Q 


10.2 Aperiodic Signal representation by Fourier Integral 

In Sec. 10.1 we succeeded in representing periodic signals as a sum of (everlast- 
ing) exponentials. In this section we extend this representation to aperiodic signals. 
The procedure is identical conceptually to that in Chapter 4 used for continuous- 
time signals. 

Applying a limiting process, we now show that aperiodic signals /[k] can be 
expressed as a continuous sum (integral) of everlasting exponentials. To represent 
an aperiodic signal /[A] such as the one illustrated in Fig. 10.3a by everlasting 
exponential signals, let us construct a new periodic signal /jv 0 [fc] formed by repeating 
the signal / [it] every No units , as shown in Fig. 10.3b. The period Nq is made long 
enough to avoid overlap between the repeating cycles (No > 2 N + 1). The periodic 
signal /jv 0 [it] can be represented by an exponential Fourier series. If we let No —> 00 
, the signal /[it] repeats after an infinite interval, and therefore 

lim /w 0 W = /[ fc ] 

Nq—> OO 


fin this example we have used the same equations as those for DFT in Example C5.2, with a 
minor difference. In the present example, the values of f[k] at k = 4 and —4 are taken as 1, 
whereas in Example 5.3 these values are 0.5. This is the reason for the slight difference in spectra 
in Fig. 10.2b and Fig. 5.16d. Unlike continuous-time signals, discrete-time signals can have no 
discontinuity. 







f < 


Tin f 



Tin ■ 


flu 


-N 0 -NON Nq k — ► 


(b) 

Fig. 10.3 Generation of a periodic signal by periodic extension of a signal f[k]. 

Thus, the Fourier series representing /jv 0 [fc] will also represent f[k] in the limit 
N 0 -* oo. The exponential Fourier series for Jn 0 [A] is given by 

MM= E v r eirQok «0=|r 

r=<N 0 > ° 

where 

Vr = ~ 

U k— — oo 

The limits for the sum on the right-hand side of Eq. (10.21) should be from -N 
to N . But because f[k) = 0 for |fc| > N, it does not matter if the limits are taken 
from -oo to oo. 

It is interesting to see how the nature of the spectrum changes as N o increases. 
To understand this fascinating behavior, let us define F(Sl), a continuous function 
of H, as 

OO 

F(il) — E (10-22) 

k— — oo 

From this definition and Eq. (10.21), we have 

V r = ±-F(ri 2„) (10.23) 

No 

This result shows that the Fourier coefficients T> r are (1/Nq) times the samples of 
F(Q) taken every fio rad/s.f Therefore, (l/Ng)F(Q) is the envelope for the coeffi- 
cients V r . We now let N 0 — > oo by doubling N 0 repeatedly. Doubling No halves the 
fundamental frequency flo so the spacing between successive spectral components 
(harmonics) is halved, and there are now twice as many components (samples) in 


fFor the sake of simplicity we assume T> r and therefore F(Q) to be real. The argument, however, 
is also valid for complex T> r [or F(f2)] . 


( 10 . 20 ) 

(10.21) 
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the spectrum. At the same time, by doubling Ng, the envelope of the coefficients 
XV is halved, as seen from Eq. (10.23). If we continue this process of doubling 
Ng repeatedly, the number of components doubles in each step; the spectrum pro- 
gressively becomes denser while its magnitude V r becomes smaller. Note, however, 
that the relative shape of the envelope remains the same (proportional to F(fi) in 
Eq. (10.22)]. In the limit, as No — » oo, the fundamental frequency Do — » 0, and 
XV — > 0. The separation between successive harmonics, which is fio, is approaching 
zero (infinitesimal), and the spectrum becomes so dense that it appears continuous. 
But as the number of harmonics increases indefinitely, the harmonic amplitudes 
XV become vanishingly small (infinitesimal). We have a strange situation of hav- 
ing nothing of everything. This phenomenon is already discussed in Chapter 4, 
where we showed that these are the classic characteristics of a familiar phenomenon 
(the density function). 

Let us see what happens mathematically as the period Ng — ► oo. According to 
Eq. (10.22) 

OO 

F(rClg) = J2 flk\e~ jrn ° k (10.24) 

fc=— oo 

Using Eqs. (10.23) and (10.21), we can express Eq. (10.20) as 

/*oM = £ F(rCl 0 )e^ ok 

0 r=<JV 0 > 

= ]T F(rCl 0 )e^ k 
r=<Na > V 2 */ 

In the limit as Nq — ♦ oo, S7o 0 and /jVoM /[&]. Therefore 

f[k] = lim V (10.26) 

^0^ o> [ 2ix J 

As Ng — > 0, Do becomes infinitesimal (fio — > 0). For this reason it will be appropri- 
ate to replace fio with an infinitesimal notation AH: 

2ir 

AU = — (10.27) 

N 0 

Equation (10.26) can be expressed as 

/[*]= lim y [ F(rAQ)An l 

1 1 ACi^o ^ 2 tt 

r—<N 0 > J 

= lim J- y F(r AfiW rAn *Afi 
Afl^o 2 -k v ' 

r=<N 0 > 

The range r =< Ng> implies the interval of Ng number of harmonics, which is 
N oAn = 27r according to Eq. (10.27). In the limit, the right-hand side of Eq. 
(10.29) becomes the integral 


(10.28) 

(10.29) 


(10.25a) 

(10.25b) 
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/[fc] = — / F(Cl)e jkn dCl (10.30) 

^ Jin 

where j 2r indicates integration over any continuous interval of 2 ir 
F(Cl) is given by (Eq. (10.22)] 

OO 

F( fi)= y f[k]e- jnk 

k~ — oo 

The integral on the right-hand side of Eq. (10.30) is called the Fourier inte- 
gral. We have now succeeded in representing an aperiodic signal f[k] by a Fourier 
integral (rather than a Fourier series). This integral is basically a Fourier series (in 
the limit) with fundamental frequency AO — > 0, as seen in Eq. (10.28). The amount 
of the exponential is F(rACl)ACl/2ir. Thus, the function F(Q.) given by Eq. 

(10.31) acts as a spectral function, which indicates the relative amounts of various 
exponential components of f[k\. 

We call F(fi) the (direct) discrete-time Fourier transform (DTFT) of / [fc] , and 
/[fc] the inverse discrete-time Fourier transform (IDTFT) of F(Q). This can be 
represented as 

F(fi) = F{f[k}} and /[fc].i= /~ X {E(n)} 

The same information is conveyed by the statement that f[k\ and F(Q) are a 
(discrete-time) Fourier transform pair. Symbolically, this is expressed as 

/[*] <=* PM 

The Fourier transform F( fl) is the frequency-domain description of / (fc] - 

10.2-1 Nature of Fourier Spectra 

We now discuss several important features of the discrete-time Fourier trans- 
form and the spectra associated with it. 

The Fourier Spectra are Continuous Functions of 0. 

It is helpful to keep in mind that the Fourier integral in Eq. (10.30) is basically 
a Fourier series with fundamental frequency Ail approaching zero [Eq. (10.28)]. 
Therefore, most of the discussion and properties of Fourier series apply to the 
Fourier transform as well. The successive harmonics are separated by the fundamen- 
tal frequency All, which approaches zero. This fact makes the spectra continuous 
functions of Cl. 

The Fourier Spectra are Periodic Functions of fi with Period 2x 

According to Eq. (10.31) it follows that 

o° oo 

F(f2 + 2tt) — y f[k]e~^ n+2 ^ k = y f{k]e- jnk e-i 2 * k = F(Cl) (10.32) 

k=~ oo fc— ~oo 

Clearly, the spectrum F(fl) is a continuous and periodic function of fi with period 
27r. We must remember, however, that to synthesize /[fc], we need to use the spec- 
trum over a frequency interval of only 27r, starting at any value of fi (see Eq. (10.30)]. 


. The spectrum 
(10.31) 
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As a matter of convenience, we shall choose this interval to be the fundamental fre- 
quency range (— ir, jr). It is, therefore, not necessary to show discrete-time-signal 
spectra beyond the fundamental range, although we often do so. 

Conjugate Symmetry of F(f2) for real / [fc] 

From Eq. (10.31), we obtain 


OO 

F(-fi) = £ f\k}e) nk 

k — — oo 

The right-hand side of this equation is the conjugate of the right-hand side of Eq. 
(10.31) for real /[fc]. Therefore, for real /[fc], F(fi) and F(-fl) are conjugates; that 
is, F(-fi) = F*{ fi). 

Since F(Cl) is generally complex, we have both amplitude and angle (or phase) 
spectra 

F(Sl) = |F(fl)|e J ' ZF(n > (10.33) 

Because of conjugate symmetry of F(f2), it follows that 

|F(0)| = |F(-n)| (10.34a) 

ZF(fl) = -ZF(-H) (10.34b) 

Therefore, the amplitude spectrum |F(fl)| is an even function of Cl and the phase 
spectrum ZF(fl) is an odd function of Cl for real /[fc]. 

Linearity of the DTFT 

According to Eq. (10.31), it follows that if 

/l [fc] <=> Fi(fl) and / 2 [fc] F 2 (Cl) 


then 

“i/i[fc] + “ 2 / 2 ( 1 =] -*=> o 1 F 1 (fI) + a 2 F2(n) (10.35) 

Existence of the DTFT 

Because |e — jfcri | = 1, from Eq. (10.31), it follows that the existence of F(fi) is 
guaranteed if /[fc] is absolutely summable; that is, 

OO 

Y, l/MI <°o (10.36) 

k — — 00 


/[fc] , 




1 1 1 I I 1 t . 


! 5 10 fc— ► 



exponentials (or sinusoids). The Fourier spectrum of a signal indicates the relative 
amplitudes and phases of the exponentials (or sinusoids) required to synthesize 
/[fc]. If /[fc] is periodic, then its Fourier spectrum has finite amplitudes and exists at 
discrete frequencies (Ho and its multiples). Such a spectrum is easy to visualize, but 
the spectrum of an aperiodic signal is not easy to visualize because it is continuous. 
The physical meaning of the continuous spectrum is fully explained in Sec. 4.1-1. 

I Example 10.3 

Find the DTFT of f[k\ = i k u[k]. 


f^) = Yi k ^ iUk 

k = 0 


This condition is sufficient but not necessary for the existence of F(fi). For instance, 
the signal /[fc] = sin fc/fc violates the condition (10.36), but does have DTFT (see 
Example 10.6). 

Physical Appreciation of the Discrete-Time Fourier Transform 

In understanding any aspect of the Fourier transform, we should remember that 
Fourier representation is a way of expressing a signal /[fc] as a sum of everlasting 


= 5 > e “ in ) 1 

fc =0 

This is a geometric progression with a common ratio -)-e~ ,n . Therefore, [see Sec. (B.7-4)] 





(10.45) 
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(b) 

Fig. 10.7 Inverse Discrete-time Fourier transform of a periodic gate spectrum. 


The signal f\k] is depicted in Fig. 10.7b (for the case Q c = */4). ■ 


A Finland sketch the amplitude and phase spectra of the DTFT of the signal f[k] - 7 |fc| wlth 

N < 1. 

Answer: 


F( ft) = 


1 - 7 2 

1 — 27 cos fi + 7 2 


V 


10.3 Properties of the DTFT 

The linearity property [Eq. (10.35)] of DTFT has been already discussed. 
Other useful properties of the DTFT are as follows: 

Time and Frequency Inversion 

f{-k] 4 => F(-n) (10.46) 

From Eq. (10.31), the DTFT of /[-*] is 

OO 00 

DTFT{/[— fc]} = £ E = 

k=-oo m=-oo 


Multiplication by k: Frequency Differentiation 


kf[k} <=> j 


dF(Q) 

d£l 


(10.4T) 


The result follows immediately by differentiating both sides of Eq. (10.31) with 
respect to O. 
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OO 

fi[k]*f 2 [k]= E /iH/afc-H 

m=— oo 

and 

Fj(fl) * F 2 (fi) = / Fi(u)F 2 (fl~u)du 

J27T 

The time convolution property is proved in Chapter 11 [Eq. (11.18)]. All we have 
to do is replace z with e J ’ n . To prove the frequency-convolution property (10.50b), 
we have 


i ku fin p~i nk 


oo °° r i f 

h m/ 2 [*]<=> E /i[WK ,m = E t/ 2 / l(u)e 

fc— — oo fc=-oo L * 

Interchanging the order of summation and integration, we obtain 


/1W/2W 4 => f Fi(«)[ E hW~ m u) ‘ du = H F i(“ )F2(n_ “ )du 

j 1* Lfc=-oo 2 * 

Parseval’s Theorem 

If 

f[k] *=> F(H) 

then Ef, the energy of f[k], is given by 


Ef = \m\ 2 -iJj F ^ dQ 


In order to prove this property, we have from Eq. (10.31) 


f*(- n)= E /*W e ~ 


This result shows that 


/*[fc] F*(-H) 


(10.51) 


(10.52a) 


(10.52b) 


00 00 °° f 1 r 

E i/wi a = E /*w/w= E /*w bi/ (n)eJ dn 

ib=— 00 fc=— 00 fc— — 00 

= — [ F(n)F*(n)dn = [ \F{n)\ 2 dQ. 

2tt ,/ 2t 2tt y 2n 


Now 
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Fig. 10.8 Connection between the DTFT and the Fourier transform. 


10.4 DTFT Connection with the Continuous-Time Fourier 
Transform 

Consider a continuous-time signal f c (t) (Fig. 10.8a) with the Fourier transform 
F c (w). This signal may or may not be bandlimited. For convenience, we shall 
assume the signal to be bandlimited to B Hz (Fig. 10.8b). This signal is sampled 
with a sampling interval T. The sampling rate may or may not be above the Nyquist 
rate. Again, for convenience, we shall assume that the sampling rate is at least equal 
to the Nyquist rate; that is, T < 1/2 B. The sampled signal J c (t) (Fig. 10.8c) can 
be expressed as 

OO 

7cW= J2 fc(kT)6(t - kT) 

k— — oo 

The continuous-time Fourier transform of the above equation yields 

OO 

FcH= fc{kT)e~ ikT “ (10.53) 

k— — oo 

In Sec. 5.1 (Fig. 5.1e), we have shown that F c (u>) is F c (w)/T repeating periodically 
with a period u, = 2n/T , as illustrated in Fig. 10.8d. Let us construct a discrete- 
time signal f[k] such that its kth element value is equal to the value of the fcth 
sample of / c (t), as depicted in Fig. 10.8e; that is, 

f[k] = fc(kT) 

Now, F( U), the DTFT of f\k], is given by 


8 12 16 20 k- 


-2 n -n 


0 71 


2 n 



Fig. 10.9 Spectra of the decimated and interpolated signals. 


oo oo 

F(Q)= J2 f[k}e~ ikn = Y, fc(kT)e~ ikn (10.54) 

k— — oo k=— oo 

Comparison of (10.54) with (10.53) shows that 

F(fl) = F c (^j (10.55) 

Thus, F(H) can be obtained from F c (u>) by replacing u> with Cl/T. Therefore, F(f2) 
is identical to F c (w) frequency-scaled by a factor T, as shown in Fig. 10.8f. 

In the above derivation, we did not have to use the assumption that f c (t) is 
bandlimited or that f c (t) is sampled at a rate at least equal to its Nyquist rate. If 
the signal were not bandlimited, the only difference in our discussion would be in the 
sketches in Fig. 10.8. For instance, F c (tu) in Fig. 10.8b would not be bandlimited. 
This fact would cause overlapping (aliasing) of repeating cycles of F c ( w) in Figs. 
10. 8d and f. A similar thing happens when the signal f c (t) is sampled below the 
Nyquist rate.) 

10.4-1 DTFT of Decimated and Interpolated Signals 

We can use Eq. (10.55) to find the DTFT of decimated and interpolated sig- 

fln case the signal is not bandlimited and/ot the sampling rate is below its Nyquist rate, the 
samples / c (fcT) can be interpreted as the Nyquist samples of the inverse Fourier transform of the 
first cycle (centered at to = 0) of TF c (u). 
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nals, which are explained in Fig. 8.17. Consider a signal f[k] and its DTFT F(fi), 
as illustrated in Figs. 10.9a and b. Figure 10.9c shows the decimated signal f[2k]. 
If f[k] is considered to be the sample sequence of a continuous-time signal f c {t), 
then f[2k] is the sample sequence of / c (2f), whose Fourier transform is given by 
|F c (u>/2) according to Eq. (4.34). f As seen in Eq. (10.55), F(fi) is F c (Cl/T) re- 
peating periodically with period 2tr, and the DTFT of f[2k] is ^ F c (f!/2T ) repeating 
periodically with period 2 it. Note that F(fl/2T) is F(f2/T) time-expanded by fac- 
tor 2, as shown in Figs. 10.9b and d. If we use mth-order decimation; that is, if 
we select every mth element in the sequence, the resulting decimated sequence will 
be f[mk], Using the above argument, it follows that in the fundamental frequency 
range, the DTFT of f[mk] will be 1/m times F(Cl/m), and it repeats periodically 
with period 2 tt. If m is too large, so that the first cycle of F(f!/m) goes beyond it , 
the successive cycles of F(fi/m) will overlap, as illustrated in Fig. 10.9d. 

Now consider the interpolated signal fi[k] in Fig. 10.9c. This signal is /[/c/2] 
(obtained by expanding f[k] by factor 2), with the alternate (missing) points filled 
by interpolated values obtained by ideal lowpass filtering. If the envelope of f[k\ 
is f c (t), then the envelope of /,[/:] is f c (t/ 2), whose Fourier transform is 2 F c (2uj). 
Thus, in the fundamental frequency range, the spectrum of fi[k] is 2 times F(fl) 
compressed by factor 2 along the frequency axis, and periodically repeating with 
period 2 tt as depicted in Fig. 10. 9f. Using a similar argument, we can generalize 
this result for a time-expanded signal /[/c/m] with missing values filled by ideal 
interpolation. In this case, the spectrum in the fundamental frequency range will 
be m times F(mO) [F(fi) frequency-compressed by factor m] repeating periodically 
with period 2 x. 

10.5 Discrete-Time Linear System Analysis by DTFT 

Consider a linear time-invariant discrete-time system with the unit impulse 
response /i[/c]. We shall find the (zero-state) system response j/[/c] for the input f[k\. 
Because 

t/[fc] = f[k] * h[k] (10.56) 

According to Eq. (10.50a) it follows that 

y(D) = F(U)H(U) (10.57) 

where F(fl), y(fi), and H (fl) are DTFTs of /[/c], y[Zc], and h[k], respectively; that 
is, 

f[k] F (ST) , y[k] -t=t> Y( fl), and /i[fc] ■<==> H(fl) 

This result is similar to that obtained for continuous-time systems. 

The Frequency Response of an LTID System 

Equation (9.57a) states that the response to an everlasting exponential input 
z k of an LTID system with transfer function H\z ] is H\z)z k . If we let z = e jf! , then 

(Here, F c (u) should be interpreted as the first cycle (centered at w = 0) of TF c {uj) 


z k = e J ~ lk , and the response to an everlasting exponential input e 3 ' lk of an LTID 
system with transfer function H\z] is H \ej a ]ej nk . This result can be represented as 
the input-output pair with a directed arrow notation as usual 

e m H y^ e m 

Also, according to Eq. (9.57b) with z = e ]n , it follows that 

CO 

H\e&} = J2 H>c}e~ jnk 

k — — oo 

Observe that the right-hand side of the above equation is H(fl), the DTFT of h[k]. 
Therefore 

H[e j(l \ = H(fl) 

and 

e m ^ 

Clearly H (fl) is the LTID system frequency response. Following the argument in 
Sec. 7.1, the amplitude response of the system is |i/(fl)|, and the phase response is 
IH( fl). We shall discuss this topic again in greater details in Chapter 12. 

Equation (10.57) states that the frequency spectrum of the output signal is the 
product of the frequency spectrum of the input signal and the frequency response 
of the system. From Eq. (10.57), we have 

|y(0)| = |F(fl)||i7(U)| (10.58) 

and 

lY(fl) = lF(fl) + lH(fl) (10.59) 

This result shows that the output amplitude spectrum is the product of the input 
amplitude spectrum and the amplitude response of the system. The output phase 
spectrum is the sum of the input phase spectrum and the phase response of the 
system. 

We can also interpret Eq. (10.57) in terms of the frequency-domain viewpoint, 
which sees a system in terms of its frequency response (system response to various 
exponential or sinusoidal components). Frequency-domain views a signal as a sum 
of various exponential or sinusoidal components. Transmission of a signal through 
a (linear) system is viewed as transmission of various exponential or sinusoidal 
components of the input signal through the system. This concept can be understood 
by displaying the input-output relationships by a directed arrow as follows: 

gjHfc H (Q)e 3nk the system response to e? nk is H(Sl)e 3 ^ ik 

f[k] = — — f F(n)e jfM: dfl shows f[k] as a sum of everlasting exponential components 
2lr J2t 

and from Eq. (10.57) 

y[k] = ^-f F(U)H(n)e m dfl y[fc] as a sum of responses to all input components 
27r Jin 
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which is precisely the relationship in Eq. (10.57). Thus, F({2) is the input spectrum 
and K(D), the output spectrum (of the exponential components), is F(Q)H(fl). 

■ Example 10.7 

For a system with unit impulse response h[fc] = (0.5)*u[fc], determine the (zero-state) 
response y[fc] for the input /[fc] = (0.8)*u[fc[. 

According to Eq. (10.57) 

Y(Q) = F(tl)H{Sl) 

FYom the results in Eq. (10.37), we obtain 


F(fi) = 


1 - 0.8e~-> n e-> n - 0.8 


Also, H(Q) is the DTFT of (0.5) fc u[fc], which is obtained from Eq. (10.37) by substituting 
~T = 0.5: 


1 - 0.5e~i n e> n - 0.5 


Therefore 


1 ’ (e’ n - 0.5) (e^ n - 0.8) 

We can express the right-hand side as a sum of two first-order terms (modified partial 
fraction expansion as discussed in Sec. B.5-5) as follows:f 

Y(Q) e* n 

( e jO - 0.5)(ei n - 0.8) 


Consequently, 


r(n) = 


ef" - 0.5 eJ n - 0.8 

_ f 5\ e in /8\ 

\3/ - 0.5 + \3/ e? a - 0.8 

I + ( T> 1_ 

V3 ) 1 - 0.5e-J“ 1 3/ 1 - 0.8e-» 


According to Eq. (10.37), the inverse DTFT of this equation is 
»[*]= [-|(0.5) fc + |(0.8) fc ] u[fc] 

This example demonstrates the procedure of determining an LTID system response 
using DTFT. It is similar to the method of Fourier transform in analysis of LTIC systems. 
As in the case of Fourier transform, this method can be used only if the system is asymp- 
totically stable and if the input signal is DTF-transformable. We shall not belabor this 
method further because it is clumsier and more restricted than the z-transform method 
discussed in the next chapter. In the z-transform, we generalize the frequency variable j(l 
to o + jfl so that the resulting exponentials can grow or decay with k. This procedure is 


(Here Y(Q) is a function of variable e-* n . Hence, x = c ' 1 ! for the purpose of comparison with the 
expression in Sec. B.5-5. 
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similar to what we did in the continuous-time case by generalizing the frequency variable 
ju> to s = a + ju (from Fourier to Laplace transform) . I 

10.6 Signal processing by DFT and FFT 

In this section, we use DFT (developed in Chapter 5) as a tool, which allows 
us to utilize a digital computer for digital signal processing. This signal processing 
includes spectral analysis of digital signals and LTID system analysis. By spectral 
analysis, we mean determining the discrete time Fourier series (DTFS) of periodic 
signals and determining F(fl) from / [A] (and vice versa) for aperiodic signals. As 
a tool for LTID system analysis, DFT can be used as a software oriented solution 
to digital filtering. DFT can be implemented on a digital computer by an efficient 
algorithm, the fast Fourier transform (FFT ) also discussed in Chapter 5. The DFT 
(using FFT) is truly the workhorse of modern digital signal processing. 

10.6-1 Computation of Discrete-Time Fourier Series (DTFS) 

The discrete-time Fourier series (DTFS) equations (10.8) and (10.9) are iden- 
tical to the DFT equations (5.18b) and (5.18a) within a scaling constant No- If we 
let f[k] = Nofk and V r = F r in Eqs. (10.9) and (10.8), we obtain 



This is precisely the DFT pair in Eqs. (5.18). For instance, to compute the DTFS 
for the periodic signal in Fig. 10.2a, we use the values of fk = f[k]/No as 


f^L 0 < fc < 4 and 28 < It < 31 

f I oZ 

/fc ~\o 5 < fc < 27 

We use these values in the FFT algorithm discussed in Sec. 5.2-2 to obtain F r , 
which is the same as T> r . 


10.6-2 Computation of Direct and Inverse DTFT 

Spectral analysis of digital signals requires determination of DTFT and IDTFT 
[determining F(tt) from /[fc] and vice versa]. This determination could be accom- 
plished by using the DTFT equations [Eqs. (10.30) and (10.31)] directly on a digital 
computer. However, there are two difficulties in implementation of these equations 
on a digital computer. 

1. Equation (10.31) involves summing an infinite number of terms, which is not 
possible because it requires infinite computer time. 

2. Equation (10.30) requires integration which can only be performed approxi- 
mately on a computer because a computer approximates an integral by a sum. 
The first problem can be surmounted either by restricting the analysis only to 

a finite length /[fc] or by truncating /[fc] by a suitable window. The error because 
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0 Nq- 1 k — ► 



Fig. 10.10 DFT computation of a finite length signal. 


of windowing may be reduced by using a wider and a tapered window. We shall 
see that if /[fc] has a finite duration, the samples of F ( D j can be computed using 
a finite sum (rather than an integral). This solves the second problem. Moreover, 
/[fc] is uniquely determined from these samples of F(D). 

In order to derive appropriate relationships, consider the signal /[fc] starting 
at fc = 0, and with a finite length N 0 , as shown in Fig. 10.10a. Let us construct a 
periodic signal f Na [fc] by repeating / [fc] periodically at intervals of N 0 , as illustrated 
in Fig. 10.10b. We can represent the periodic signal } No [fc] by the discrete-time 
Fourier series (DTFS) as [see Bqs. (10.8) and (10.9)] 


N 0 - 1 

/w„[fe] = J2 V re jrn ° k 

r = 0 


O _ 2* 

U 0 — — 
No 


(10.62) 


where 

, N 0 -i 

= /[fc]e--”' n ° fc (10.63) 

0 k = 0 

In Eq. (10.63) we used the fact that /tv 0 M = /[*] for k = 0, 1, 2, . . . , N 0 - 1. 

By definition, the DTFT of f[k] is 


N 0 -l 

F (ty = f[k]e~ jnk (10.64) 

fc =0 

According to Eqs. (10.63) and (10.64), it follows that N 0 V r is F(rD 0 ), the rth 
sample of F(D). For convenience, we denote this sample by F r . Thus 


Therefore, NoD r are the samples of F(D) taken uniformly at the frequency intervals 
of Do- But because Do = 2jr/Ao> there are exactly No number of these samples of 
F(D) over the fundamental frequency interval of 2ir. According to Eqs. (10.62) and 
(10.65), it follows that 


, No-l 

/N,W = F E^ rW (10.66) 

N ° T^o 

where [from Eqs. (10.63) and (10.65)] 

N 0 - 1 

F r = f[k]e- jrSl ° k (10.67) 

fc =0 

Because /noM = /[fc] for fc = 0, 1,2,..., (N 0 - 1), we can express the Eq. (10.66) 
as 

, N 0 -i 

/[fc] = — y' F r e jrShk fc = 0, 1, 2, ..., N 0 - 1 (10-68) 

N ° T^o 

Moreover, we need to determine F r , the samples of the DTFT, only over the interval 
0 < D < 27r. Therefore, Eq. (10.67) can be expressed as 

Wo-l 

F r = /[fc]e-l rn ° fc r = 0, 1,2,..., No — 1 (10-69) 

fc= o 

Equations (10.68) and (10.69) are precisely the DFT pair derived in Eqs. (5.18a) 
and (5.18b). These equations relate F r [the samples of F(fi)] to /[fc] and vice 
versa. Here F r is the DFT of /[fc] and / [fc] is the IDFT (inverse DFT) of F T - This 
relationship is also denoted by the bidirectional arrow notation of a transform as 

/[fc] •$=* F r 

To repeat, F r , the DFT of an No-point sequence /[fc], is a set of uniform samples 
of its DTFT F(Q) taken at frequency intervals of Do — The sequence /[fc] 
and its DFT F r are related by Eqs. (10.68) and (10.69). Observe that there are 
No elements in /[fc]. Also, there are exactly No elements in F r (over the frequency 
range 2ir). The DFT relationships are finite sums and can be readily computed on 
a digital computer using the efficient fast Fourier transform (FFT) algorithm. 

Properties of DFT 

We list some of the important properties of DFT proved in Chapter 5. from the 
preceding discussion, it follows that these properties of DFT also apply to DTFT 
samples of a finite length /[fc], 

1. Linearity: If /[fc] •«=> F r and g[k] <=^- G r , then 


N 0 V r = F(r Do) = F, 


(10.65) 


a l/[fc] + 023 [fc] a lF r + 02 G 


(10.70) 
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2. Conjugate Symmetry: For real /[fc] 

F No -r = F r * (10.71) 

There is a conjugate symmetry about No/2, which enables us to determine roughly 
half the values of F r from the other half of the values, when f[k] is real. For 
instance, in a 7-point DFT, Fq = F\* , F$ = F 2 * and F4 = F 3 * . In an 8-point DFT, 
F 7 = Fj*, F 6 = F 2 *, F 5 = F 3 *, and so on. 

3. Time Shifting (Circular Shifting): 

f[k - n] <=>• F T e~^ n (10.72) 

4. Frequency Shifting: 

f{k)e ikn ° m <=> F r _ m (10.73) 

5. Circular (or Periodic) Convolution: 

/[fc]©3[fc] <=> F r G r (10.74a) 

and 

/[fc]s[fc] <==> —F r ®G r (10.74b) 

N 0 

where the circular (or periodic) convolution of two Ao-point periodic sequences f[k\ 
and </(fc] is defined as 


JVo-l Ao-1 

/[*] = X] - "] = g[n}fl k - n] 


n=0 


n—0 


(10.75) 


Caution in Interpreting DFT and IDFT 

Equations (10.68) and (10.69) allow us to compute samples of DTFT and 
IDTFT for a finite length signal on a digital computer. To avoid certain pitfalls, 
we must understand clearly the nature of functions synthesized by the sums on the 
right-hand side of these equations. According to Eq. (10.66), it follows that the sum 
on the right-hand side of Eq. (10.68) is /jv„ [*], which is a periodic signal of which 
/[fc] is the first cycle. Similarly, the sum on the right-hand side of Eq. (10.69) is 
periodic. This is because F r = N 0 V r , which is periodic. Therefore, both the DFT 
equations are periodic. We require only part of these results (over one cycle) to 
compute the samples of F(H) from f[k] and vice versa. That is why we placed the 
restriction that k or r = 0, 1, 2, . . . , Ao — 1 in Eqs. (10.68) and (10.69). 

Signal f\k] can start at any value of k. 

In deriving the above results, we assumed that the signal f[k] starts at k = 0. 
This restriction, fortunately, is not necessary. We now show that this procedure 
can be applied to / [fc] starting at any instant. Recall that the DFT found by this 
procedure is actually the DFT of /at 0 [fc], which is a periodic extension of f[k ] with 
period N 0 . In other words, /w 0 [fc ] can be generated from f[k] by placing /[fc] and 
reproduction thereof end to end ad infinitum. Consider now the signal / [fc] in 
Fig. 10.6 in which f[k\ begins at fc = -4. The periodic extension of this signal is 
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depicted in Fig. 10.2a for N 0 = 32. A careful glance at this figure shows that this 
periodic signal can be constructed by any segment of length 32 and repeating it 
periodically by placing it end to end ad infinitum. We may choose a segment over 
the range fc = -16 to 15 or a segment over the range fc = 0 to 31, or any other 
segment of length 32. The reader should satisfy himself that the periodic extension 
of any such segment yields the same periodic signal /w 0 [fc]. Therefore, the DFT 
corresponding to the periodic signal /n 0 \k] is the DFT of any of its segment of N 0 
length starting at any point. So the signal / [fc] may start at any point. All we need 
is to construct a periodic signal fN 0 [ k ] which is a periodic extension of /[fc], then 
compute the DFT according to Eq. (10.68) using the sample values in the range 
fc = 0 to No - I- For instance, the signed /[fc] in Fig. 10.6 does not start at fc = 0. 
But we can construct its periodic extension /tv 0 [fc], as shown in Fig. 10.2a, and use 
the values for fc = 0, 1, 2, . . . , 31 in Eq. (10.69) to compute F r . These values are 


Hence, according to Eq. 10.69 


and 


0 < fc < 4 and 
5 < fc < 27 


F 0 = 


No-l 

£ /M = 9 


Jfc=0 


28 < fc < 31 


Fl _ e -in 0 + e -j2Qo + e -mo + e -mo + e -128«o + e -j29f!o + e ~j30Cl 0 + g j31£Jo 

Because H 0 = ^ we recognize that e -# in ° = e* n °, = e ^ n «, and so on. 

Hence 


Fi = 1 + 2(cos Ho + cos 2O 0 + cos 3H 0 + cos 4O 0 ) = 7.8865 

Note that Fo = 9 is the first sample of F(f!) , F] = F(^) is the second sample, and 
so on. The samples are spaced ir/16 radians apart, giving a total of 32 samples in 
the fundamental frequency range. The reader may confirm these values from from 
Eq. (10.44). 

I Example 10.8 

Find the DFT of a 3-point signal /[fc] illustrated in Fig. 10.11a. 

Figure 10.11a shows /[fc] (solid line) and /iv 0 [fc] obtained by periodic extension of /[fc] 
(shown by dotted lines). In this case 

No = 3 and Ho = -g- 

From Eq. (10.69), we obtain 

F r = X)/W e ' jr(¥)fc = 3 + 2e ~ 3r ^ + 3e “ ir ^ 

fc=o 

Therefore 

F 0 = 3 + 2 + 3 = 8 

Fi = 3 + 2e~* + 3e-'» = 3 + (-1 - ,V§) + (-§ + ^ 

F 2 = 3 + 2e-^+3e-^ = 3 + (-1 + ]Vz) + ~ J^) = e ”^ 
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Fig. 10.11 Computation of DFT of a signal f[k]. 
The magnitudes and angles of F r are shown in the Table below. 


r 

0 

T| 

2 1 

\Fr\ 

8 

i 

1 1 

LF r 

0 

Tl 

-1 1 


Observe that F 2 - F' (the conjugate symmetry property). Because f[k\ is a 3-point 
sequence, F r (its DFT) is also a 3-point sequence, which repeats periodically. Figure 
10.11b shows F r and ZF r . Recall that the DFT gives only the sample values of F( 12). We 
want to know if DFT has enough samples to give a reasonably good idea of DTFT. The 
DTFT for /[fc] is given by [Eq. (10.31)] 

2 

F(Q) = Y / me~ jnk = 3 + 2e-’ n + 3e~> 2n = e^ n [2 + 3^ + 3e-^] = e - jn (2 + 6 cos 12) 

fc =0 


The DFT in this example has too few points to give a reasonable picture of the 
DTFT. The peak of DTFT appearing between the second and the third sample (between 
r = 1 and 2), for instance, is missed by the DFT. The two valleys of the DTFT are also 
missed. We definitely need more points in the DFT for an acceptable resolution. This 
goal is accomplished by zero padding, explained below. B 

Use of Zero Padding 

The DFT yields the samples of DTFT at the frequency intervals of 12o = 
2tt/Nq, where f2o is the frequency resolution. Seeing the DTFT through DFT 
is like viewing F( f2) through a picket fence. Only the spectral components at 
the sampled frequencies (which are integral multiples of 12o) will be visible. But 
frequency components lying in between will be hidden behind the picket fence. 
If DFT has too few points, major peaks and valleys of F(12) existing between the 
DFT points (sampled frequencies) will not be seen, thus giving an erroneous view of 
the spectrum F(12). This is precisely the case in Example 10.8. Actually, using the 
interpolation formula, it is possible to compute any number of values of DTFT from 
the DFT. But having to use the interpolation formula really defeats the purpose of 
DFT. We therefore seek to reduce f2o so that the number of samples is increased 
for a better view of the DTFT. 

Because f2o = 2 x/A 1 0 , we can reduce f2 0 by increasing N 0 , the length of /[fc]. 
For a finite length sequence, the only way to increase N 0 is by appending sufficient 
number of zero valued points to /[fc]. This procedure of zero padding is depicted 
in Fig. 10.10c. Recall that No is the period of InM, which is formed by periodic 
repetition of / [fc]. By appending sufficient number of zeros to /[fc], as illustrated in 
Fig. 10.10c, we can increase the period No as much as we wish, thereby increasing 
the number of points of the DFT. Recall that the number of points of both /[fc] as 
well as F r are identical (N 0 ). We shall rework example 10.8 using zero padding to 
increase the number of samples of DTFT. 

B Example 10.9 

Do Example 10.8 by padding three zeros to /[fc]. 

Figure 10.12a shows the zero padded /[fc], and the corresponding /n 0 [fc] ■ Now /[fc] is 
a 6-point sequence. Hence, 


No = 6, 


and 



7 r 

3 


The amplitude and phase spectra are given by 


|F(12)| = |2 + 6 cos 12| 

( -12 when (2 + 6 cos 12) > 0 

m i2) = { 

1 IT — 12 when (2 + 6 cos 12) < 0 

Figure 10. lib shows [ F (12) | and ZF(12) (dotted). Observe that DFT values are exactly 
equal to DTFT values at the sampling frequencies; there is no approximation. This is 
always true of DFT of a finite length /[fc]. However, if /[fc] is obtained by truncating or 
windowing a longer sequence, we shall see that the DFT gives only approximate sample 
values of the DTFT. 


and from Eq. (10.69), we obtain 

5 

Fr = Y, /M<=~ ir(?)it = 3 + 2e- jr ? + 3e~ ir ^ 

fc= 0 

Therefore 

F 0 = 3 + 2 + 3 = 8 

F, =3 + 2e -'* +3e-'» =3 + (1-W3) + (-§ - = (§ - = 5*"'* 

In the same way, we find 
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Fig. 10.12 DFT of a signal with zero padding. 


F2 = 3 + 2e--’^+3e--'^=e 5 'f 
Fj = 3 + 2e~j* + 3e -j2 ’ r = 4 
F< = 3 + 2e - -'^ +3e'-’T = e ~ 3 f 
P's = 3 + 2 + 3e~- ,i 3 2!; -5 e if 

The magnitude and angles of F r are shown in the Table below 


r 

0 

~ 1 2 1 3 I 4 | 5 ~| 

|FV| 

8 

5 | 1 | 4 | 1 | 5 | 

IF. 

0 

-f 1 f 1 0 1 -f IT 1 


Observe that F s = F, and F< = F 2 * as expected from the conjugate symmetry 
property. Figure 1°. 12 b shows the plots of |F r | and lF r . Observe that we now have a 6- 
point DFT, which provides 6 samples of the DTFT spaced at the frequency interval of ir/3 
(in contrast to 2 tt/ 3 spacing in Example 10.8). The samples corresponding to r = 0 2 
and 4 in Example 10.9 are identical to the samples corresponding to r = 0 1 and 2 in 
Example 10.8. The DFT spectrum in Fig. 10.12b contains all the three samples appearing 
in tig. 10.11b plus 3 more samples in between. Clearly, the zero padding allows us a better 
assessment^ ofthe DTFT. But even in this case, the valleys of the F(Q) are missed by this 


O Computer Example CIO. 3 

Use MATLAB to do Example 10.8 to yield 32 sample values of DTFT. 
Because the signal length is 3, we need to pad 29 zeros to the signal. 
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N0=32;k=O:N-l; 

f= [3 2 3 zeros(l,N0-3)]; 

Fr=fft(f) 

r=k; 

subplot(3,l,l) 

stem(k,f); 

xlabelf’k’^ylabelf’flk]’); 

subplot(3,l,2) 

stem(r,abs(Fr)) 

xlabel(V);ylabel(’Fr’); 

subplot(3,l,3); 

stem(r,angle(Fr)) 

xlabel(’r’);ylabel(’angle Fr’);grid on; Q 


m Example 10.10 

For the signal f[k] in Example 10.8, we need a frequency resolution Q 0 = 7 t/ 6 for a 
reasonable view of F(D). Determine the number of zeros needed to be padded, and write 
the expression for computing the DFT. 

For a resolution of Do — tt/ 6, the padded length No of the signal is 

a; _ 2?r _ 2?r _ 19 

N 0 = cT — 7Z 12 

Do tt/6 

The padded length required is 12. Therefore we need to pad 9 zeros to f[k\. In this case 




However, the last 9 samples of f[k] are zero. Therefore, the above equation reduces to 


F r = £/[k]e-^' 


-Hf) k 


A Exercise El 0.4 

A 3-point signal f[k] is specified by /[0] = 2, /[— 1] = /[ 1] = 1, and f[k] = 0 for all 
other k. Show that the DFT of this signal is Fo = 4, F\ = 1, and F 2 = 1. Find F(f2), the 
DTFT of this signal, and verify that the DFT is equal to the samples of the DTFT at intervals of 
ujq = 2tt/No = 27t/3. V 

A Exercise E10.5 

Show that the 8-point DFT of the signal f[k] in Exercise E10.4 is 

F 0 = 4, Fi = 3.4142, F 2 = 2, F 3 = 0.5858, F 4 = 0, F 5 = 0.5858, F 6 = 2, F 7 = 3.4142 


Observe the conjugate symmetry of F r about r = Nq/2 = 4. V 


Practical Choice of Nq The value of TVo is determined by the desired resolution 
Do- However, there is another consideration in selecting a value of No. If we are 
using the FFT algorithm to compute the DFT, then for efficient computation of 
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8-point DFT for signal (0.8)*« 


Fig. 10.13 DFT computations for /[fc] = (0.8) fc u[fc] using an 8-point rectangular window. 

DFT, N 0 should be a power of 2. Hence, we often pad sufficient numbers of zeros 
to ensure this requirement. 


Effect of Signal truncation 

So far we have considered only finite length sequences. For such sequences, we 
can readily find the No-point DFT, where No is at least equal to the length of the 
sequence. How do we handle signals of infinite length? It is practically impossible to 
process infinite length sequences, because they generally require an infinite number 
of computations. Fortunately, every practical signal /[fc ] must decay with k (because 
of a finite energy requirement), and such signal becomes negligibly small beyond 
k > N 0 for some suitable value of N 0 . For instance, the signal /[fc] = (0.6)* has 
infinite length. However, /[fc] < 0.00028 at fc > 16. Hence, we may truncate this 
signal beyond fc = 16 (or even a little earlier). Straightforward signal truncation 
in this manner amounts to using a rectangular window with a unit weight for the 
data in the range 0 < fc < N 0 , and zero weight for the data beyond fc = N 0 . 
Such a truncation results in Gibbs phenomenon with consequent oscillations in the 
spectrum of the truncated signal as demonstrated in the following example. 

H Example 10.11 

The signal /[fc] = (0.8)*u[fc] has infinite length. Find the DFT of this signal using an 
8-point rectangular window. 

The DTFT of this signal obtained in Eq. (10.37) is 


|F(fi)| = 


'1.64 — 1.6cos Q 


The 8-point rectangular window function is 


The windowed signal is 



0 < fc < 7 
otherwise 



0 < fc < 7 


otherwise 
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The DFT of the windowed signal is obtained using the FFT algorithm. Figure 10.13a shows 
the windowed signal and Fig. 10.13b shows the corresponding 8-point DFT. The dotted 
curve shows the DTFT amplitude |F(fl)| of the complete (untruncated) signal (0.8)*u[fc] 
for comparison. The unbroken oscillating curve is the plot of the DTFT amplitude for 
the truncated (8-point) signal. The oscillations are because of the Gibbs phenomenon 
arising from the rectangular window. Observe the interesting fact that the 8 DFT values 
computed from the truncated signal are exactly equal to the 8 samples of the DTFT of 
the complete signal. 

10.6-3 Discrete Time Filtering (Convolution) Using DFT 

The DFT is useful not only in the computation of direct and inverse Fourier 
transforms, but also in other applications such as filtering, convolution, and cor- 
relation. Use of the efficient FFT algorithm makes DFT particularly appealing. 
We generally think of filtering in terms of some hardware-oriented solution (using 
summers, multipliers, and delay elements). However, filtering also has a software- 
oriented solution [a computer algorithm that yields the filtered output y(t) for a 
given input /(t)]. Such filtering can be conveniently accomplished by using the 
DFT. 

Filtering can be accomplished either in the frequency domain or in the time 
domain. In the frequency domain approach, for a given input /[fc], we are required 
to find the output y[k] of a filter with a given transfer function IT (Si). In the time 
domain approach, for a given input /[fc], we are required to find the output y\k] of a 
filter with a given impulse response h [fc] . In the time domain, the output is obtained 
by (linear) convolution of /[fc] with fc[fc]. In the frequency domain, the output is 
obtained as an IDFT of F r H r with F r = F(rQ 0 ) and H r = B(rU 0 ). Because the 
frequency domain method appears as a substep of the time domain method, we 
shall consider here only the time domain (convolution) method. 

We would like to perform linear convolution required in filtering operation using 
DFT (utilizing FFT algorithm) because of its computational efficiency. However, 
DFT can be used to evaluate only the circular convolution, not the linear convolu- 
tion. Fortunately, linear convolution can be made equivalent to circular convolution 
by suitably padding the two sequences with zeros. This statement, introduced in 
Chapter 5, will now be proved. 

When is Linear Convolution Equivalent to Circular Convolution? 

The circular (or periodic) convolution, is explained in Sec. 5.2-1. In circular 
convolution, both sequences to be convolved are No-periodic. If /[fc] and < 7 [fc] are 
both A'o-periodic, their periodic (or circular) convolution c[fc] is defined as 

No— 1 

c[fc] = /[fc] ®g[k] = f[m]g[k - m\ (10.76) 

m=0 

Note that the circular convolution differs from the regular (linear) convolution by 
the fact that the summation is over one period (starting at any point). In the linear 
convolution, the summation is from — oo to oo . The result of a periodic convolution 
is also an No-periodic sequence. 
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Suppose we wish to convolve two finite length sequences /[fc] and h{k\ of length 
N f and N h , respectively. Let y[k\ be the (linear) convolution of these sequences- 
that is, 

y[k) = /[fc ] * h[k\ (10.77) 

From the width property of the convolution (Sec. 9.4), the length of y[k] is (. N f + 
Nh - 1). Let the DTFT of the sequences /[*], h[k], and t/[fc] be E(fi), H(U), and 
F(fl), respectively. Then, from Eq. (10.50a), we have 

Y(n) = F(0)H(tl) (10.78) 


We know that the DFT of an JV 0 -point sequence is the set of uniform samples of its 
DTFT at frequency interval fl 0 = '2n/N 0 . Therefore, if Y r is the W 0 -point DFT of 
j/[fe], then 

y r = Y (rtoo) a 0 = — (10.79) 


According to Eq. (10.78) it follows that 


Y r = F r H r 


(10.80) 


where F r and H r are the rth samples of F(Q) and H(Q), respectively. For Eq. 
(10.80) to be valid, F r and H r must be compatible for multiplication. In other 
words, both must be A 0 -point sequences if Y r is an <V 0 -point sequence. But we 
know that f[k], fc[fc], and y[k\ are Nf, N h , and N 0 = (N f +N h - l)-point sequences. 
Hence, we must pad N h - 1 zeros to /[fc] and pad N f - 1 zeros to A[fc] to ensure 
that F r , H r , and Y r are all Nq = (Nf + N h - l)-point sequences. Once we compute 
F r and H r (after suitably zero-padding /[fc] and ft[fc]), we take the IDFT of F r H r 
to obtain y[k). However, we have shown in Chapter 5 [Eq. (5.32a)] that F r H r is the 
DFT of a circular convolution of f[k] and fc[fc]; that is f\k\ ® h[fc] <=^ F r H r . This 
result means y[k] is equal to the circular convolution of (suitably padded) f[k] and 
A[fc]. Thus, y[k\ is a periodic sequence whose first period is the linear convolution 
of (unpadded) /[*] and fc[fc], To summarize, y[fc], which is the linear convolution of 
f\k] and fc[fc], is also equal to the circular convolution of suitably padded /[fc] and 
A[l:]. This is an extremely important result. The system response is given by the 
linear convolution of /[fc] and h{k\. But the preceding result allows us to compute 
this convolution as if it were the circular convolution of (suitably padded) /[fc] and 
A[fc], This, in turn, allows us to use DFT to perform the computations. 

The procedure to find the (linear) convolution of /[fc] and fc[fc], whose lengths 
are Nf and N h , respectively, can be summarized in four steps as follows: 

1. Pad N h - 1 zeros to /[fc] and Nf - 1 zeros to h[fc], 

2. Find F r and H T , the DFTs of the zero-padded sequences f[k] and h{k\. 

3. Multiply F r by H r to obtain Y r . 

4. The desired convolution y [fc] is the IDFT of Y r . 


Filtering In the Frequency Domain If we are given the filter transfer function 
we know H r . We compute F r , the DFT of f[k\. Then follow the steps 3 and 
4 to obtain the output y\k}. 
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a -2 0123456 -4 -2 0123456 -6 -4 -2 012345678 

fc— fc— *— 


Fig. 10.14 Linear convolution of signals /[fc] and h[fc] using DFT. 

H Example 10.12 

Find y[fc], the output of an LTID filter with impulse response h[fc] to an input f[k] 
illustrated in Figs. 10.14a and b. 

We obtain the convolution y[k\ in four steps listed above. 

1. In this case Nf — 3 and Nh = 2. Therefore, we pad 1 zero to /[fc] and 2 zeros to h[k], 
as depicted in Figs. 10.14c and d, respectively. 

2. Now, No = 4 and H 0 = tt/ 2. The DFTs F r and H r of the zero-padded sequences /[fc] 
and h\k] are given by 

2 2 

Fr = ]T/(fc]e- jrn ' >fc = Y,fi k ] e ' iTik 
k=0 k = 0 

= 3 + 2e~ j ? r + 3e' j7rr 


l l 

Hr = j2 h ^ e ~ jrn ° k = Y2 h W e ~ irik 

k = 0 fc=0 

= 2 + 2e~ j t r 

Substituting r = 0, 1, 2, 3, we obtain 

F 0 = 8 Fi = —2j F 2 = 4 

Ho = 4 Hi = 2V2e~ j i H 2 = 0 

3. Multiply F r by H r to obtain Y r . This step yields 

To = 32 Y\ = 4v / 2e - -’^ 1 Y 2 = 0 Y 3 = 4V2e jS Y 

4. The desired convolution is the IDFT of Y r , given by 


F 3 = 2 j 
H 3 = 2\/2e J i 
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Substitution of r = 0, 1, 2, 3 in this equation yields 

y[0]=6 j/[l] = 10 y[2] = 10 y[3] = 6 

Figure 10.14e shows y{k\ and its periodic extension (dotted). The IDFT yields the 
periodic signal. We need only the first cycle. I 

o Computer Example C10.4 

Use MATLAB to do Example 10.12. Find the answer by direct convolution as well 
as by using DFT. 

In performing the convolution via DFT, we shall use the command ’fft(f,L)’, which 
gives the FFT of a sequence f with sufficient zeros padded to make its length equal to L. 

f=[3 2 3]; 
h=[2 2]; 

L=length(f)+length(h)-l; 

k=0:l:L-l; 

% Linear convolution: Direct approach 

yl=conv(f,h); 

subplot(2,l,2) 

stem(k,yl) 

% Linear Convoiution:via DFT 
FE=fft(f,L); 

HE=fft(h,L); 
y2=ifft(FE.*HE); 
subplot(2,l,l); 
stem(k,y2) Q 

O Computer Example C10.5 

Use MATLAB to convolve (0.8)*u[fc] and (0.5) fc u[fc], Find the answer by direct con- 
volution and using DFT. 

Both the signals have infinite duration. Hence, we must truncate them beyond some 
suitable value of k, where both functions become negligible. For this purpose k — 32 is a 
reasonable choice. 

R=32; 

m=0:l:R-l; 

f=(0.8)."m; 

h=(0.5).'m; 

L=length(f)+length(h)-l; 

k=0:l:L-l; 

% Linear convolution: Direct approach 

yl=conv(f,h); 

subplot(2,l,2) 

stem(k,yl) 

% Linear Convolution:via DFT 
FE=fft(f,L); 

HE=fft(h,L); 

y2=ifft(FE.*HE); 

k=0:l:L-l; 

subplot (2,1,1) ;stem(k,y2) 
stem(k,y2) Q 


A Exercise E10.6 

Show that the circular convolution of two 3-point sequences 3, 2, 3, and 1, 2, 3 , (both 
starting at it = 0) is also a 3-point sequence 15, 17, 16. Find the answer by using DFT, and 
verify your answer using the graphical method explained in Fig. 5.17. Using the sliding tape 
method (Fig. 9.4), show that the linear convolution of these sequences is a 5-point sequence 
3, 8, 16, 12, 9. Indicate how you will obtain the linear convolution of these two sequences using 
circular convolution. V 
A Exercise E10.7 

The input /[ifc] of an LTID system is a 4-point sequence 1, 1, 1, 1, and Il k ] , the impulse 
response of the system, is a 3-point sequence 1, 2, 1. Both sequences start at fc = 0. Using DFT, 
show that the output y[fc] is a 6-point sequence 1, 3, 4, 4, 3, 1 starting at k = 0. Verify your 
answer by deriving the output as a linear convolution of the two sequences using the sliding tape 
method. V 

Efficacy of DFT in Convolution Computation 

Using the sliding tape algorithm discussed in Chapter 9, we can perform the 
convolution in Example 10.12 with a mere 6 (real) multiplications and 2 additions. 
The DFT method discussed in this section appears much too laborious, and the 
use of DFT for convolution may seem questionable. Recall, however, our discussion 
in Sec. 5.3, which showed that the use of FFT algorithm to compute DFT reduces 
the number of computations dramatically, especially for large Nq. For small length 
sequences, the direct convolution method, such as the sliding tape method is faster 
than the DFT method. But for long sequences, the DFT method using the FFT 
algorithm is much faster and far more efficient.) The method of finding convolution 
using the fast Fourier transform (FFT) is known as the fast convolution. 

Block Filtering or Convolution 

In practice, the length of an input signal may be very large, whereas a computer 
processing such a signal may have a limited memory. To process such long sequences, 
we can section the input signal into blocks of a length small enough to be processed 
by a given computer, and then add the outputs resulting from all the input blocks. 
This procedure can be used because the operation is linear. Such a procedure would 
be desirable even if the processing computer had an unlimited memory. For longer 
inputs, we must wait a long time before the input is fed to the computer (before 
it even starts processing), and then an even longer time for processing the large 
amount of data. Consequently, there is a long delay in the output. Sectioning the 
input allows the output to have a smaller processing delay. We shall now discuss 
two such method of block processing, overlap and add method and overlap and 
save method. Either of the methods requires the same number of computations; 
hence, which method is used is a matter of choice. 

Overlap and Add Method 

Consider a filtering operation, where the output y[k ] is the convolution of the 
input f[k] and a FIR filter impulse response h[k] of length M . In practice, usually 

fit can be shown that in convolution of two sequences, each of length No, the number of com- 
putations required is on the order of Nq, whereas for DFT, using FFT algorithm, the number of 
computations required is only on the order of No log 2 No- 
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Nonoverlapping 
data blocks 


L 


L 


L 


Zero-padded 
data blocks 


AM 


M - 1 


AM 


Output blocks 


L Ml 

No. 1 


L-M+l 

No. 2 


AM 


M - 1 


L-M+l 


M - 1 


Fig. 10.15 Overlap and add method of block Hltering. 


M is much smaller than the length of the input. Figure 10.15 illustrates a long 
input sequence sectioned into nonoverlapping blocks of a manageable length L. 
The number inside each block indicates its length. Let us assume that L » M . We 
now process each block of the input data in sequence. To be able to use the circular 
convolution for performing the linear convolution, we need to pad M - 1 zeros at 
the end of each data block. J Figure 10.15 shows each data block augmented by 
M - 1 zeros. The augmented portion of the block is shown shaded. Observe that 
the augmented (zero-padded) blocks of the input, each of length L + M - 1, now 
overlap. 

The output sequence corresponding to each block also has a length L + M - 1 
(recall that the length of the circular convolution of two sequences, each of length 
L + M — 1, is also L+M- 1). The output sequences, therefore, also overlap, as shown 
in Fig. 10.15. The total output is given by the sum of all these overlapping output 
blocks of length L + M - 1. The contents of the two successive blocks are added 
wherever they overlap. This method is known as the overlap and add method. 

H Example 10.13 

Using overlap and add method of block filtering, find the response yjifc] of an LTID 
system, whose impulse response /i[k] and the input /[fc] are shown in Fig. 10.16. 

The output y[fc] is a linear convolution of f[k] and Let us use L = 3 for the 
block convolution. Also M = 2. Hence, we need to break the input sequence in blocks of 
3 digits and pad each block with M — 1 = 1 zero, as depicted in Fig. 10.16. We convolve 
each of these blocks with h[fc] using DFT, as demonstrated in Example 10.11. 

In this case, No — 4 and Do = ir/4. The DFTs F r and H r of the zero-padded 
sequences /[fc] and /i[fc] are given by 

2 r 

F t = and H r = h\k]e~ ir i k 

k~ 0 k—0 

| We also pad h[k] with L — 1 zeros so that the length of the padded h[k\ is L *f M — 1. 


m 


(a) 


li 


1. 1 . tt - 


012345678 




k-+ 



Fig. 10.16 An Example of overlap ami add method of block filtering. 


Also, Y r = FrHr. We compute the values of F r , Hr, and Y r using these equations for each 
block: 

For the first block, 


F r = 3 + 2e~ j % r + 3e~ j * r , 


Hr = 2 + 2e~^ r and Yr - F r H r 


Also 

y [k] = i]T>e^5 fc = \ (Vo + + Y^ k + Y 3 e^ k ) 

r= 0 


Substituting r = 0, 1, 2, 3, we obtain 

Fo = 8 Fi = -2j F 2 = 4 

Ho = 4 Hi — 2\/2e *5 H 2 = 0 

Vo = 32 Yi = 4\/2e-^ Y 2 = 0 

y [0] = 6 y[ll = 10 y[2] = 10 


F 3 = 2 j 
H 3 = 2-/2e : * 
Y 3 = iV2e j ^ 
y[3] = 6 


Using the same procedure for the second block, we obtain 


y[0] = 2, y[l] = 2 y[2] = 2, y[3] = 2 

For the third block, we obtain 

y[0] = 0, y[l] = 2 y[2] = 4, y[3] = 2 

Figure 10.16 shows the overlapping input and output blocks, and the convolution sequence 
obtained by adding the output blocks. ^ 

The procedure using DFT given here is much more laborious than the direct con- 
volution by the sliding tape method (Sec. 9.4). The reason is that we did not use FFT 
algorithm to compute DFT here. In this example, with a rather small No, even FFT will 
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No 3 



Discard No. 3 


Fig. 10.17 Overlap and Save method of block filtering. 

have more number of computations than the direct convolution. In practice, we generally 
deal with much larger values of No, where use of DFT (utilizing FFT algorithm) pays 
off. It will be informative for the reader to find linear convolution (using the sliding tape 
method) of one unpadded data block with unpadded h[fcj. Next, find the circular convo- 
lution of the same data block padded with 1 zero and h\k] padded with 2 zeros. Use the 
graphical method of circular convolution illustrated in Fig. 5.17. Verify that you get the 
same answer in both cases. H 


Overlap and Save Method 

In the overlap and save method also, the input sequence is sectioned into 
nonoverlapping blocks of a manageable length L. As before, each block is aug- 
mented with M - 1 data points. But unlike the previous method, this method 
places augmented points at the beginning of each block. The augmented M — 1 
data points of a block are the same as the last M - 1 points of the previous block 
so that the last M - 1 data points of each block also appear as the first M - 1 
data points of the succeeding block. The exception is the first block, where the first 
1 data points are taken as zeros, as shown in Fig. 10.17. We now convolve 
each of these blocks with h\k ] (padded by L - 1 zeros). As before, DFT is used to 
perform convolution. 

The output sequence corresponding to each block also has a length L + M — 1. 
We discard the first M — 1 data points and save the last L data points from each 
output block, as depicted in Fig. 10.17. The total output is given by combining 
all the saved blocks in sequence. This method is known as the overlap and save 
method. More details of this method can be found in the literature. 1 


■ Example 10.14 

Using overlap and save method of block filtering, find the response y[k] of an LTID 
system, whose impulse response h[fc] and the input are illustrated in Fig. 10.16. 
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We follow the procedure given in Fig. 10.17 to section the input data as shown in 
Fig. 10.18. Note that the first M - 1 = 1 data point of the first block is padded (zero) and 
the last M — 1 = 1 point of each block also appears as the first point of the next block. 
Each block of length L-M + 1 = 4 is now convolved (using DFT) with h[k] (padded with 
two zeros). The DFT procedure is already explained in Example 10.13. We shall omit the 
details here, the resulting output blocks are depicted in Fig. 10.18. The first M - 1 = 1 
point of each output block is discarded. The total output is given by combining all the 
saved blocks in sequence. H 

0 Computer Example C10.6 

Use MATLAB to do example 10.13 (overlap and add method). 

Here, we use the MATLAB command ’fftfilt(h,f,M)’ to perform convolution using 
overlap and add method with blocks of length M. This m-file is available in Signal Pro- 
cessing Toolbox. 

f— [3 2 3 1 0 1 0 1 1]; 
h=[2 2]; 

L=length(f)-flength(h)-l; 

k=0:l:L-2; 
y=fftfilt(h,f,3); 
stem(k,real(y)); Q 

A Exercise E10.8 

The input f[k] of an LTID system is a sequence 1, 0, -1, 2, ..., and h[k], the impulse 
response of the system is a 3-point sequence 3, 2, 3. Both sequences start at fc = 0. Using block 
convolution with L = 2, show that the output is 3, 2, 0, 4, . . .. Derive your answer using both 
methods of block filtering. V 


10.7 Generalization of the DTFT to the Z- Transform 

LTID systems can be analyzed using DTFT. This method, however, has the 
following limitations; 

1. Existence of the DTFT is guaranteed only for absolutely summable signals [see 
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Eq. (10.36)]. The DTFT does not exist for exponentially growing signals. This 
means the DTFT method can be applied only for a limited class of inputs. 

2. Moreover, this method can be applied only to asymptotically stable systems; 
it cannot be used for unstable or even marginally stable systems. 

These are serious limitations in the study of LTID system analysis. Actually it 
is the first limitation that is also the cause of the second limitation. Because DTFT 
is incapable of handling growing signals, it is incapable of handling unstable or 
marginally stable systems.) Our goal is, therefore, to extend the concept of DTFT 
so that it can handle exponentially growing signals. 

We may wonder what causes this limitation on DTFT so that it is incapable of 
handling exponentially growing signals. Recall that in DTFT, we are synthesizing 
an arbitrary signal /[*;] using sinusoids or exponentials of the form e jnk . These 
signals are sinusoids with constant amplitudes. They are incapable of synthesizing 
exponentially growing signals no matter how many such components we add. Our 
hope, therefore, lies in trying to synthesize /[fc] using exponentially growing sinu- 
soids or exponentials. This goal can be accomplished by generalizing the frequency 
variable jCt to a 4- jfi; that is, by using exponentials of the form instead 

of exponentials e jfl . The procedure is almost identical to that used in extending 
the Fourier transform to the Laplace transform in Sec. 6.1. The intuitive argument 
is identical to that discussed in Sec. 6.1, and the reader may wish to review it to 
refresh his memory. Here we shall go straight to the analytical development. 

As in the case of Fourier to Laplace, it is desirable to use the notation F(jSl) 
instead of F(U) for the DTFT in order to unify the DTFT and the generalized 
transform (z-transform). Thus, 


OO 


F(/n)= Y M e ~ m 

k =— oo 

(10.81) 

and 

f[k] = ij F W ejQkda 

(10.82) 

Consider now the DTFT of /[fc] e — ( a real ) 



oo 

DTFT [/[fc] e~ <rk \ = Y 

fc= — OO 

oo 

= Y /Me _(a+3 ' n)A: 

fc— — OO 


It follows from Eq. (10.81) that the above sum is F{a + jCl). Thus 

OO 

DTFT [ f[k ] e - '’*] = Y /M e~ i<,+jSl)k = F (° + 3 tt ) 

k— — oo 


(10.83) 

(10.84) 


(10.85) 



Fig. 10.19 Contour of integration for the z-transform. 


Hence, the inverse DTFT of F(a + jU) is /[fc] e- ak . Therefore 

/[fc] e -° k = J- [ F{a+jCl) e jQk dO. 

Multiplying both sides of the above equation by e ak yields 

/[fc] = ^ F (a +jU)e^ + ^ k dQ 

2rr 7— ir 


(10.86) 


(10.87) 


Let us define a new variable z as 

z = e <r+jft so that In z = a + jQ. and i dz = j dSl (10.88) 

Because z = e a+jn is complex, we can express it as z = r e jfi , where r = e a . Thus, 
z lies on a circle of radius r, and as Q varies from -ir to tt, z circumambulates 
along this circle, completing exactly one rotation in counterclockwise direction, as 
illustrated in Fig. 10.19. Changing to variable z in Eq. (10.87) yields 

/[fc] = _L j F ( In z) z*- 1 dz (10.89a) 

and from Eq. (10.85) we obtain 


oo 

F(lnz) = Y /M* - * (1 °' 89b) 

fc=— OO 

where the integral j indicates a contour integral around a circle of radius r in 
counterclockwise direction. 

The above two equations are the desired extensions. They are, however, in a 
clumsy form. For the sake of convenience, we make a notational change by noting 
that F(lnz) is a function of z. Let us denote it by a simpler notation F[z], Thus, 
Eqs. (10.89) become 


/Recall that the output of an unstable system grows exponentially. Also, the output of a marginally 
stable system to characteristic mode input grows with time. 


(10.90) 
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and 

OO 

F M = J2 fW z ~ k (10.91) 

k — — oo 

This is the (bilateral) 2 -transform pair. Equation (10.90) expresses /[l] as a contin- 
uous sum of exponentials of the form z k = e ( a +Yi)k — r k e jak xhus, by selecting 
a proper value for r (or a), we can make the exponential grow (or decay) at any 
exponential rate we desire. 

If we let a = 0, we have z = and 

F\ x \ ~ F(ln2) = F(jQ.) = F(f2) (10.92) 

Thus, the familiar DTFT is just a special case of the 2 -transform F\z) obtained bv 
letting 2 = e j!i . 

10.8 Summary 

This chapter deals with analysis and processing of discrete-time signals. For 
analysis, our approach is parallel to that used in continuous-time signals. We first 
represent a periodic f[k] as a Fourier series formed by a discrete-time exponential 
and its harmonics. Later we extend this representation to an aperiodic signal /[it] 
by considering /[l] as a limiting case of a periodic signal with period approaching 
infinity. Periodic signals are represented by discrete-time Fourier series (DTFS); 
aperiodic signals are represented by the discrete-time Fourier transform (DTFT). 
The development, although similar to that of continuous-time signals, also reveals 
some significant differences. The basic difference in the two cases arises because 
a continuous-time exponential e jut has a unique waveform for every value of u in 
the range -oo to oo. In contrast, a discrete-time exponential e jnk has a unique 
waveform only for values of U in a continuous interval of 2?r. Therefore, if fi 0 is 
the fundamental frequency, then at most ^ number of exponentials in the Fourier 
series are independent. Consequently, the discrete-time exponential Fourier series 
has only N 0 = ^ terms. 

The discrete-time Fourier transform (DTFT) of an aperiodic signal is a contin- 
uous function of fl and is periodic with period 2x. We can synthesize F(fl) from 
its spectral components in any band of width 2tt. Linear time- invariant discrete- 
time (LTID) systems can be analyzed using DTFT if the input signals are DTF- 
transformable and if the system is stable. Analysis of unstable (or marginally sta- 
ble) systems and/or exponentially growing inputs can be performed by 2 -transform, 
which is a generalized DTFT. The relationship of DTFT to 2 -transform is similar to 
that of the Fourier transform to the Laplace transform. Whereas the 2 -transform 
is superior to DTFT for analysis of LTID systems, DTFT is preferable in signal 
analysis. 

If H(Q) is the DTFT of the system’s impulse response h[fc], then |A(0)| is the 
amplitude response, and IH (fl) is the phase response of the system. Moreover, 
if F(Q) and Y [fl) are the DTFTs of the input /[fc] and the corresponding output 
y\k], then Y( fl) = H (fl)F(fl). Therefore the output spectrum is the product of the 
input spectrum and the system’s frequency response. 

The numerical computations in modern digital signal processing can be conve- 
niently performed with the discrete Fourier transform (DFT) introduced in Chapter 
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5. The DFT computations can be very efficiently executed by using the fast Fourier 
transform (FFT) algorithm. The DFT is indeed the workhorse of modern digital 
signal processing. The discrete-time Fourier transform (DTFT) and the inverse 
discrete-time Fourier transform (IDTFT) can be computed using the DFT. For an 
Ao-point signal /[it], its DFT yields exactly A 0 samples of F(Q) at frequency in- 
tervals of 2'k/No . We can obtain a larger number of samples of F(fl) by padding 
sufficient number of zero valued samples to f[k\. The Ao-point DFT of f[k] gives 
exact values of the DTFT samples if / [fc] has a finite length Aq. If the length of 
f[k ] is infinite, we need to truncate f{k\ using the appropriate window function. 

Because of the convolution property, we can compute convolution of two signals 
/[it] and h[k] using DFT. For this purpose, we need to pad both the signals by a 
suitable number of zeros so as to make the linear convolution of the two signals 
identical to the circular (or periodic) convolution of the padded signals. Large blocks 
of data may be processed by sectioning the data into smaller blocks and processing 
such smaller blocks in sequence. Such a procedure requires smaller memory and 
reduces the processing time. 
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Problems 

10.1- 1 Find the discrete-time Fourier series (DTFS) and sketch their spectra |Z> r | and IV T 

for 0 < r < Ao - 1 for the following periodic signal: 

f[k] = 4 cos 2Ank + 2sin 3.2nk 

Hint: Reduce frequencies to the fundamental range (0 < H < 2x). The fundamental 
frequency Do is the largest number of which the frequencies appearing in the Fourier 
series are integral multiples. 

10.1- 2 Repeat Prob. 10.1-1 if /[k] = cos 2.2jrfc cos 3.3nk. 

10.1- 3 Repeat Prob. 10.1-1 if f[k] — 2cos 3.27r(fc — 3). 


Fig. P10.1-4 

10.1-4 Find the discrete-time Fourier series and the corresponding amplitude and phase 
spectra for the /[fc] shown in Fig. P10.1-4. 
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10.1- 5 Repeat Prob. 10.1-4 for the /[fc] depicted in Fig. P10.1-5. 

10.1- 6 Repeat Prob. 10.1-4 for the /[fc] illustrated in Fig. P10.1-6. 



Fig. P10.1-5 


12 15 *- 



Fig. P10.1-6 

10 ‘ 1 ' 7 f J k] iS in terms ° f *“°‘her signal *[fc] over an interval (Ni < 

/W c®[*] Ni < k < N 2 

=}[4°-!iw^XTame a inters minimiZeS ° f the 6rr ° r 


1 N 2 
c ~ w E 

k=N l 

the zt m r d xlk] are said to be ortho «° nai 

discrete-time signals ^ ^ t0 define the tonality of 

(c) Show that the set of signals e jrn ° k for r = 0 1 2 3 N _ i • , 

over an interval (0 < fc < /v i\ u . * ’ 5 ’ * ‘ ‘ ’ ^ 1S orthogonal 

using the result in part 7a) ° ' ’ ex Ponential Fourier series (DTFS) 

Hint: Recall that if w is complex, then \w\ 2 = ww* 

10.1-8 An /Vo-periodic signal /[*] is represented by its DTFS as in Eo fin Si P d 

val-s theorem (for DTFS), which states that “ ^ (1 °' 8) ' PrWe ParS ^ 

w 0 E i/wi 2 = E i°-i 2 

1-<JV 0 > r=<1V 0 > 

Earlier [Eq. (10.51)], we obtained the Pareseval’s theorem for DTFT. 
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Hint: If w is complex, then |ui| 2 = ww’ , and use Eq. (5.43). 

10.2- 1 For the following signals, find the DTFT directly, using the definition in Eq. (10.31). 

(a) /[fc] = f>[fc] (b) 6[fc — ko\ (c) a fc u[fc — 1] |aj < 1 
(d) /[fc] = a k u[k + 1] |o| < 1. 

In each case, sketch the signal and its amplitude spectrum. Sketch phase spectra for 
parts (a) and (b) only. 

10.2- 2 Find the DTFT for the signals shown in Fig. P8.2-9 (Chapter 8). 



Fig. P10.2-3 


10.2- 3 Find the inverse DTFT for the spectrum depicted in Fig. P10.2-3. 

10.3- 1 Using the time-shifting property and the results in Examples 10.3 and 10.5, find the 

DTFT of (a) a fc {u[fc] - u[fc - 10]} (b) u[fc] - u[fc - 9]. 

10.3- 2 Using appropriate properties and the result in Example 10.3, find the DTFT of (a) 

(fc + l)a fc u[k] (|a| < 1) (b) a k cos nofcuffc]- 

10.4- 1 For the spectrum F{tl) in Fig. P10.2-3 

(a) Find and sketch its IDTFT /[fc]. 

(b) Sketch / [2fc] , /[4fc], and find their DTFTs. 

(c) Sketch /[fc/2] and fill in the alternate missing samples using ideal interpolation 
(upsampling by a factor 2). Find the DTFT of the resulting interpolated (upsampled) 
signal /j[fc]. 

10.5- 1 Using the DTFT method, find the zero-state response y[fc] of a causal system with 

frequency response 

H( o) - e3ii + °- 32 
1 } ~ ei™ + e& + 0.16 

and the input 

/[fc] = (— 0.5) fc u[fc] 



10.6-1 Find the DFT of a 3-point signal /[fc] specified by /[- 1] = /[0] = 3, /[ 1] = 2 and 
/[fc] = 0 otherwise. Now determine F(£l), the DTFT of /[fc], and verify that DFT 
values are the samples of F(£l). 
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(b) Show that the 3-point DFT of this signal is identical to that of the signal /[*] ; n 
Fig. 10. 1 la. Can you explain why? Does this mean the DTFTs of the two signals are 
adso identical? Determine the DTFTs of the two signals and see if they are identical 
(for all values of ft). 

(c) Find the 8-point DFT of f[k]. 

10.6- 2 (a) Find the 4-point and 8-point DFT of a 4-point signal specified by the sequence 

1, 2, 2, 1 starting at fc = 0. 

(b) Find F(f2), the DTFT of }{k], and verify the DFT values from F(fi). 

10.6- 3 (a)Find the DFT of the signal /[fc] = $[*]. Find also F(!l), the DTFT of £[fc], and 

verify the DFT values from F(Q). Note that this is a 1-point signal (No = 1). 

(b) Show that the DFT of /[*] = <5(1 - m] is the same as the DFT of <5[fc] for any 
integral value of m. Explain this behavior. 

(c) Repeat part (a) for the No-point DFT (found by padding No - 1 zeros to <5[fc|). 
Explain this DFT from F( fl) found in part (a). 

10.6- 4 (a) Find the DFT of the No-point signal f[k] = u[fc] - u[k - N 0 ], Find F(fi), the 

DTFT of f[k] and verify that the DFT values are the uniform samples of DTFT at 
frequency intervals of fl 0 = 2ir/No. 

(b) Is the DTFT found in part (a) an adequate frequency-domain description of /[fc]. 
If not, what needs to be done to obtain a reasonably adequate DFT? 

10.6- 5 (a) Find the 5-point and 8-point DFT of the signal f[k\ illustrated in Fig. P8.2-9d. 

(b) Find F( fl), the DTFT of /[l], and verify the DFT values from F( fl). 
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10.6-6 (a) Using the graphical method shown in Fig. 5.17, find the circular convolution of 

the sequences /[fc] and p[fc], depicted in Fig. P10.6-6. 

(b) Using the sliding tape method (Fig. 9.4), find the linear convolution of the first 
cycles (over the range 0 < k < 3) of the sequences }{k\ and g\k], Is the result same 
as that found in part (a)? 

(c) The circular convolution can be made equivalent to the linear convolution by 
suitably padding (the first cycle of) the sequences f[k] and p[fc] with zeros. How many 
zeros do you need to pad to /[fc] and fc[fc]? After suitably padding these sequences, 
perform the circular convolution using the graphical method illustrated in Fig. 5.17, 
and show that it is equivalent to the linear convolution found in part (b) 

(d) Find the circular convolution of /[A] and g[k\ obtained in part (a) using DFT. 

(e) Find the linear convolution of f[k\ and g[k\ obtained in part (b) using DFT. 




Fig. P10.6-7 


10.6-7 Find the output of a system with impulse response fc[fc] and the input J\k\ shown in 
Fig. P10.6-7 by the following methods: (i)using linear convolution of }[k\ and g[k] by 
sliding tape method (ii) using circular convolution of suitably padded /[fc] and g[k] 
using the graphical method, depicted in Fig. 5.17 (iii) using DFT. 
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10.6- 8 (a) Repeat Prob. 10.6-7 for the signals /[fc] and fc[fc] illustrated in Fig. P10.6-8. 

10.6- 9 Using both the methods of block filtering (overlap and add, and overlap and save), 

find the output of a filter with impulse response fc[fc] and the input /[fc] shown in 
Fig. P10.6-9. Take L — 3. Verify that the linear convolution of the input sequence 
/[fc] = (1, —2, 3, 0, —1, 2,...} with fc[fc] = {2, 2} gives the same output as that 
found by the block filtering methods. 

10.6-10 Find the 16-point IDFT of F( 12) in Fig. 10.7a. Do the values of IDFT agree with the 
values of /[fc] found in Eq. 10.45. If not, why not? 



Discrete-Time System Analysis 
Using the Z-Transform 


The counterpart of the Laplace transform for discrete-time systems is the z- 
transform. The Laplace transform converts integro-differential equations into alge- 
braic equations. In the same way, the z-transforms changes difference equations into 
algebraic equations, thereby simplifying the analysis of discrete-time systems. The 
z-transform method of analysis of discrete-time systems parallels the Laplace trans- 
form method of analysis of continuous-time systems, with some minor differences. 
In fact, we shall see that the z-transform is the Laplace transform in disguise. 

The behavior of discrete-time systems (with some differences) is similar to 
that of continuous-time systems. The frequency-domain analysis of discrete-time 
systems is based on the fact (proved in Sec. 9.4-2) that the response of a linear 
time-invariant discrete-time (LTID) system to an everlasting exponential z k is also 
the same exponential (within a multiplicative constant), given by H[z}z k . We then 
express an input f\k] as a sum of (everlasting) exponentials of the form z k . The 
system response to f[k] is then found as a sum of the system’s responses to all these 
exponential components. The tool which allows us to represent an arbitrary input 
/[*:) as a sum of (everlasting) exponentials of the form z k is the z-transform. 

11.1 The Z-Transform 

In the last Chapter, we extended the discrete-time Fourier transform to derive 
the pair of equations defining the z-transform as 

OO 

F l z 1 = J2 f W z ~ k ( 11 - 1 ) 

k——oo 

/[fc] = 2 Vj j F[z]zk ~ X dz (H-2) 


668 


11.1 The 2-Transform 


669 


where the symbol § indicates an integration in counterclockwise direction around 
a closed path in the complex plane (see Fig. 11.1). As in the case of the Laplace 
transform, we need not worry about this integral at this point because inverse z- 
transforms of many signals of engineering interest can be found in a z-transform 
Table. The direct and inverse z-transforms can be expressed symbolically as 


F[z] = Z{f[k}} and }[k\ = Z~ l {F\z}} 


or simply as 


Note that 


2- 1 [Z{f[k]}] = f\k] and 2 [Z- 1 ^}}] = F[z] 

Following the earlier argument, we can find an LTID system response to an 
input f[k] using the steps as follows: 

z k => H[z]z k the system response to z k is H[z]z k 

f[k) = — — (p F[z\z k ~ 1 dz shows f[k] as a sum of everlasting exponential components 

and 

y [fc] = - — 7 Cp F[z\H[z\z k ~ l dz shows y[k] as a sum of responses to exponential components 

2 *j J 

= - i £ T[zlz fc_1 dz 

2 nj J 1 1 

where 

Y[z] = F[z)H[z] 

In conclusion, we have shown that for an LTID system with transfer function H[z\, 
if the input and the output are /[fc] and y[fc], respectively, and if 

f[k] <(=t> F[z] y\k] <=» Y[z ] 

then 

Y[z) = F\z\H\z\ 

We shall derive this result more formally later. 

Linearity of the 2-Transform 

Like the Laplace transform, the z-transform is a linear operator. If 
h[k] «=)> Fi[z] and f 2 [k] F 2 [z] 


aifl[k] + a 2 f2[k] aiFi[z] +a 2 F 2 [z] 
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The proof is trivial and follows from the definition of the z-transform. This result 
can be extended to finite sums. 

The Unilateral 2-Transform 

For the same reasons discussed in Chapter 6, we first start with a simpler 
version of the z-transform, the unilateral z-transform, that is restricted only to 
the analysis of causal systems with causal inputs (signals starting at k = 0). The 
more general bilateral z-transform is discussed later in Sec. 11.7. In the unilateral 
case, the signals are restricted to be causal; that is, they start at k = 0. The 
definition of the unilateral transform is the same as that of the bilateral [Eq. (11.1)] 
except that the limits of the sum are from 0 to oo 

OO 

*>] = £/(%■* (11.4) 

fc =0 

where z is complex in general. The expression for the inverse z-transform in Eq. 
(11.2) remains valid for the unilateral case also. 

The Region of Convergence of F[z] 

The sum in Eq. (11.1) [or (11.4)] defining the direct z-transform F\z] may not 
converge (exist) for all values of z. The values of z (the region in the complex 
plane) for which the sum in Eq. (11.1) converges (or exists) is called the region of 
convergence (or region of existence) of F(z[. This concept will become clear in 
the following example. 

I Example 11.1 

Find the z-transform and the corresponding region of convergence for the signal 
l k u[k\. 

By definition 

OO 

F[z\ = Y^ k u[k]z- k 
k = o 

Since tt[fc] = 1 for all k > 0, 

00 t 

k = 0 

=i+ G) + 6) a+ (9* + - + - < u - 5 > 

It is helpful to remember the following well-known geometric progression and its sum: 

l + x + x 2 + x 3 + ---= if \x\ < 1 (11.6) 

Use of Eq. (11.6) in Eq. (11-5) yields 

AH = -i-y 
1- ~ 
z 

z 

Z - 1 




Fig. 11.1 7 fc u[fc] and the region of convergence of its z-transform. 

Observe that F[z] exists only for |z| > | 7 |- For |z| < | 7 |, the sum in Eq. (11.5) does not 
converge; it goes to infinity. Therefore, the region of convergence (or existence) of F[z] is 
the shaded region outside the circle of radius | 7 |, centered at the origin, in the z-plane, as 
depicted in Fig. 11.1b. H 

The region of convergence is required for evaluating /[fc] from F[z], according to 
Eq. (11.2). The integral in Eq. (11.2) is a contour integral implying integration in a 
counterclockwise direction along a closed path centered at the origin and satisfying 
the condition |z| > | 7 |. Thus, any circular path centered at the origin and with a 
radius greater than | 7 | (Fig. 11.1b) will suffice. We can show that the integral in Eq. 
(11.2) along any such path (with a radius greater than | 7 |) yields the same result, 
namely /[*]. Such integration in the complex plane requires a background in the 
theory of functions of complex variables. We can avoid this integration by compiling 
a table of z-transforms (Table 11.1), where z-transform pairs are tabulated for a 
variety of signals. To find the inverse z-transform of say, z/(z - 7), instead of 
using the complex integration in (11.2), we consult the table and find the inverse 
z-transform of z/(z - 7) as 7 fc u[fcj. Although the table given here is rather short, 
it comprises the functions of most practical interest. 

The bilateral z-transform is defined by Eq. (11.1) with the limits of the right- 
hand sum from -00 to 00 instead of from 0 to 00. The situation of the z-transform 
regarding the uniqueness of the inverse transform is parallel to that of the Laplace 
transform. For the bilateral case, the inverse z-transform is not unique unless the 
region of convergence is specified. For the unilateral case, the inverse transform is 
unique; the region of convergence need not be specified to determine the inverse z- 
transform. For this reason, we shall ignore the region of convergence in the unilateral 
z-transform Table 11.1. 

Existence of the 2- Transform 

By definition 

fc= 0 fc=o 


H > 111 


(11.7) 
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The existence of the 2 -transform is guaranteed if 


l*HI < E 


\m\ 

^ w* 

=0 1 1 


< oo 


for some |z|. Any signal /[fc] that grows no faster than an exponential signal r 0 fc , 
for some ro, satisfies this condition. Thus, if 

1/ E*3I < r-o fc for some r 0 (11-8) 

then 

Therefore, F[z] exists for |z| > ro- All practical signals satisfy (11.8) and are 
therefore z-transformable. Some signal models (e.g. -y k ) which grow faster than 
the exponential signal r 0 k (for any r 0 ) do not satisfy (11.8) and therefore are not z- 
transformable. Fortunately, such signals are of little practical or theoretical interest. 

I Example 11.2 

Find the z-transforms of (a) S[k\ (b) u[k\ (c) cos 0ku{k\ (d) signal shown in Fig. 

11 . 2 . 

Recall that by definition 


OO 

f[«] = £/[*]*"* 

=m+ m + m + m + ... 

(a) For f\k\ = <5[fc], /[0] = 1 and /[ 2] = /[3] = /[ 4] = • • • = 0. Therefore 

6[fc] 4=6 1 for all z 

(b) For /[fc] = u[fc], /[0] = /[ 1] = /[3] = • • • = 1. Therefore 

F[z\ = l + i + -L + J- + ... 

From Eq. (11.6) it follows that 


(11.9) 


( 11 . 10 ) 


F[z] = -Xr 

1 -- 

z 

__ z 
z — 1 



I z 1 


\z\ > 1 


Therefore 


-u(fc] • 


z 

z — 1 


(c) Recall that cos /3 k = (e^ fe + e /2. 

«**«[*] 


|z| > 1 (11.11) 

Moreover, according to Eq. (11.7), 

W > [e ±j7? l = 1 


Therefore 


1 [ z z ] 

F W = 2 + ,-e-iflJ 

z(z - cos ft) 
z 2 — 2 z cos (3 + 1 


(d) Here /[ 0] = /[l] = /[ 2] = /[3] = /[ 4] = 1 and /[5] = /[6] = • ■ ■ = 0. Therefore, 
according to Eq. (11.9) 


F[z] = 1 + - 
1 J z 




z 4 + z 3 + z 2 + 2+1 


We can also express this result in a closed form by summing the geometric progression 
on the right-hand side of the above equation, using the formula in Sec. B.7-4. Here the 
common ratio r = j , M = 0, and N = 4, so that 


F[z] = 


(i) 6 -(i)° 


: - 1 


ll 

/,[* 

] 




0 

I 1 2 3 4 fc— 


Fig. 11.2 


1- 

/ 2 [ fc] 







0 

4 5678 

9 “ ° t 


Fig. 11.3 


A (a) Find the z- transform of a signal shown in Fig. 11.3. (b) Using Pair 12a (Table 11.1) find 
the z-transform of /[fc] = 20.65(\/2) fc cos (])fc — 1.415) u[fc]. 


Answers: (a) F[z] : 


z 5 + z 4 + +z 3 + z 2 + z + 1 


: — 1 


(z- 4 - ; 


(b) 


z(3.2z + 17.2) 

z 2 - 2z + 2 


V 


11.1-1 Finding the Inverse Transform 

As in the Laplace transform, we shall avoid the integration in the complex 
plane required to find the inverse z-transform [Eq. (11.2)] by using the (unilateral) 
transform Table. Many of the transforms F[z] of practical interest are rational 
functions (ratio of polynomials in z). Such functions can be expressed as a sum of 
simpler functions using partial fraction expansion. This method works because for 
every transformable /[fc] defined for fc > 0, there is a corresponding unique F\z] 
defined for |z| > r 0 (where r 0 is some constant), and vice versa. 
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Table 11.1: (Unilateral) z-Transform Pairs 



1 f[k-j] 

2 u[fc] 

3 ku[k] 

4 fc 2 u[fc] 

5 fc 3 u[fc] 

6 7* _1 u[A: - 1] 

7 7 k u[k] 

8 kz/ k u[k] 

9 k 2 ~i k u[k) 

10 *(t-i)(*-Q)--(t— » + !) 1. H 

7 m m! 

11a |7| fc cos 0k u[k] 

116 |7 | fc sin 0k u[fc] 

12a r|7| fc cos (/3fc + S)«[fc] 

126 r I7 | fc cos (0k + 0)u[k] 7 = \l\e^ 

12c r|7| fc cos (0k + #)u[k] 

r - 
* = cos " 


/ A 2 1-yl 2 4- B 2 -2 AaB 
It! 3 -a 2 


z i 

Z 

z — l 
z 

z(z + 1) 

(TTTF 

z(z 2 + 4 z + l) 

(* - 1) 4 

1 

z - 7 
z 

z - 7 
7 * 

(z-7) 2 

7z(z + 7) 

(*- 7 ) 3 

z 

(z - 7 ) m + 1 

z(z - I7I cos 0) 
z 2 - (2|7 |cos 0)z + I7I 2 

z|7| sin 0 

z 2 - (2)7! cos 0)z + I7I 2 

rz\z cos 0 - It | cos (0 - 0)] 
z 2 - (2|7 |cos 0)z + I7 j 2 

( 0.5 re^ e )z ( 0.5 re _j9 )z 

z — 7 z — 7* 

z(Az + B) 

z 2 + 2az + I7I 2 
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■ Example 11.3 

Find the inverse z transform of 

8z - 19 z(2z 2 -llz + 12) 2z(3z + 17) 

(a) (z — 2)(z — ~3) (b) (z-l)(z-2)3 ( c > (z — l)(z 2 — 6z + 25) 

(a) Expanding F[z] into partial fractions yields 

, 8z - 19 3 _5_ 

~ (z- 2 )(z -3) z - 2 + z - 3 

From Table 11.1, Pair 6, we obtain 

f[k] = [3(2) fc— 1 + 5(3) fc_1 ] u[fc - 1] (11.12a) 

If we expand rational F[z\ into partial fractions directly, we shall always obtain an answer 
that is multiplied by u[k - 1] because of the nature of Pair 6 in Table 11.1. This form 
is rather awkward as well as inconvenient. We prefer the form that is multiplied by 
rather than u[fc - 1], A glance at Table 11.1 shows that the z-transform of every signal 
that is multiplied by u[fc] has a factor z in the numerator. This observation suggests that 
we expand F[z] into modified partial fractions, where each term has a factor z in the 
numerator. This goal can be accomplished by expanding F[z]jz into partial fractions and 
then multiplying both sides by z. We shall demonstrate this procedure by reworking part 
(a) in Example 11.3. For this case 

F[z] _ 8z - 19 
z z(z - 2)(z - 3) 

(-19/6) (3/2) (5/3) 

z z-2z-3 

Multiplying both sides by z yields 

From Pairs 1 and 7 in Table 11.1, it follows that 

f[k] = -f «[fc] + [|(2) fc + §(3) fc ] u[fc] (11.12b) 

The reader can verify that this answer is equivalent to that in Eq. (11.12a) by computing 
f[k] in both cases for k = 0, 1, 2, 3, • • • , and then comparing the results. The form in Eq. 
(11.12b) is more convenient than that in Eq. (11.12a). For this reason, we shall always 
expand F[z]/z rather than F[z] into partial fractions and then multiply both sides by z 
to obtain modified partial fractions of F[z], which have a factor z in the numerator. 


(b) 


F[z] = 


z(2z 2 - llz + 12) 

(z — l)(z — 2) 3 


F[z] _ 2z 2 — llz + 12 
z " (z - l)(z - 2)3 

k ao , m ± 

- 7^1 + (z - 2)3 + (z - 2) 2 + (z - 2) 


and 
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Method of First-Order Factors 

Flzl 2(3 Z + 17) _ 2(30 + 17) 

T _ (z-l)( 0 2 — 60 + 25) (z-l)(z-3-j4)(z-3 + j4) 

We find the partial fraction of F[z}/z using the Heaviside “cover-up” method: 

F[z] _ _2_ 1.6e ~-’ 2 ' 246 1.6e ^ 2 246 

z 0 — l "*"0 — 3-j4 0 — 3 + j4 

The inverse transform of the first term on the right-hand side is 2u[fc). The inverse trans- 
form of the remaining two terms (complex conjugate poles) can be obtained from Pair 
(Table 11.1) by identifying § = 1.6, 6 = -2.246 rad., 7 = 3+j4 = 5e^ 927 , so that | 7 | = 5, 
/} = 0.927. Therefore 

f[k] = [2 + 3.2(5)* cos (0.927fc - 2.246)] u[fc] 

Method of Quadratic Factors 

F[z] _ 2(3z + 17) = _2_ Az + B 

z ~ (z - 1)(0 2 - 60 + 25) 0 - 1 0 2 - 60 + 25 

Multiplying both sides by 0 and letting 0 — 00 , we find 

0 = 2 + A=^A = ~2 


2(30 + 17) _2_ -2 0 + B 

(0 - 1 )( 0 2 - 60 + 25) 0-1 0 2 - 60 + 25 

To find B, we let 0 take any convenient value, say 0 = 0. This step yields 


^ = - 2 +^- 
25 25 


Multiplying both sides by 25 yields 


Therefore 


-34 = -50 + B ==> B = 16 


i - 1 0 2 - 60 + 25 




We now use Pair 12c where we identify A = -2, B = 16, | 7 | - 5, a - 3. Therefore 


/ 100+256-192 -39 /3 = cos _I (|) = 0.927 rad., and 


6 = tan _ 1 (^r) = -2.246 rad., so that 
/[fc] = [2 + 3.2(5)* cos (0.927fc - 2.246)] u[fc] 
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The procedure for finding partial fractions using MATLAB was demonstrated 
in chapter 6. The same program can be used in this case, except that we have 
to find the modified partial fractions here. This goal is readily accomplished by 
dividing F[z\ by z and then taking the partial fractions. We shall demonstrate this 
procedure with an example. 

O Computer Example Cll.l 

Solve Example 11.3a using MATLAB. 

nnm=[8 -19]; den=[conv([l -2],[1 -3]) 0]; 

[ r > Pt k]= residue(num,den) 

'/. We could also express den=[l -5 6 0] 


F[z] = -3.1667 + 

z - 2 z - 3 

A Exercise E11.2 

Find the inverse z-transform of the following functions: 
r.t _ *(?*-!) 1 


(z-l)(z + 0.5) 


(z - l)(z + 0.5) 
5z(z — 1) 

- 1.62 + 0.8 


(z + 2)(z - 0.5) 2 - z 2 - 1.62 + 0.8 

Answer: (a) [f + f(-0.5) k ] «[*] (b) -26{k] + [| + |(-0.5) fc ] «[*] 

(c) 18«[fc) - [0.72(— 2) fc + 17.28(0.5)* - 14.4*(0.5) fc ]u[k] 

(d) ^ 2 ^ cos (0.464A: + 0.464)u[Jfe]. Hint: \^8 = -L. v 

Inverse Transform by Expansion of F[z] in Power Series of z _1 

By definition 


f \ z \ = yyw* 


Z Z z z 6 

= /[0]*° + /[l]*- 1 + /[2]z- 2 + /[3]z -3 + ■ • ■ 

This result is a power series in z _1 . Therefore, if we can expand F[z] into a power 
series in z _1 , the coefficients of this power series can be identified as /[0], /[l], /[ 2], 
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/[3], • • •, and so on. A rational F[z] can be expanded into a power series of z 1 by 
dividing its numerator by the denominator. Consider, for example, 

F[z] = ^ - 2 > 

11 (z - 0.2)(z - 0.5)(z - 1) 

7 z 3 - 2 z 2 

_ z 3 - 1.7z 2 + 0.8z-0.1 

To obtain a series expansion in powers of z -1 , we divide the numerator by the 
denominator as follows: 

7 + 9.9z -1 + 11.23z~ 2 +11.87z~ 3 H 

z 3 - 1.7z 2 + 0.8z - 0.1 )7z 3 - 2z 2 

7z 3 -11.9z 2 + 5.60z- 0.7 

9.9z 2 — 5.60z+0.7 
9.9z 2 — 16.83z+ 7.92 - 0.99Z - 1 
11.23z-7.22 + 0.99z _1 
li^sz-io.og + s.gsz -1 
11.87- 7.99Z - 1 


Thus 

Elzl = 

U (z - 0.2)(z - 0.5)(z - 1) 

Therefore 


7 + 9.9z _1 + 11.23z“ 2 + 11.87z -3 + • • ■ 


/[0] = 7, /[l] = 9.9, / [2] = 11.23, / [3] = 11.87, ■ • • , and so on. 

We give here a simple MATLAB program to find the first N terms of the inverse 
z-transform. 


O Computer Example Cl 1.2 

Using MATLAB, find the first 10 values (/[0] through /[9]) of the inverse z-transform 
of F[z] in the above example. 

num=[7 -2 0 0]; den=[l -1.7 0.8 -0.1]; 
f=dimpulse(num, den, 10) 

7* We could also write den=conv(conv( [1 -0.2],[1 -0.5]), [1 -1]) 
f = 

7 . 0000 

9 . 9000 

11.2300 

11.8710 

12.1867 

12.3436 

12.4218 

12.4609 

12.4805 

12.4902 © 
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Although this procedure yields f[k] directly, it does not provide a closed-form 
solution. For this reason, it is not very useful unless we want to know only the first 
few terms of the sequence /[it]. 

■ \ Exercise Ell. 3 

Using long division to find the power series in z~ l , show that the inverse 2-transform of 
2/(2 - 0.5) is (0.5)*w[fc] or (2 )~ k u[k]. V 

Relationship Between h[k] and H[z] 

For an LTID system, if h[fc] is its unit impulse response, then in Eq. (9.57b) 
we defined H[z], the system transfer function, as 

OO 

H[z] = h[k]z- k 

OO 

For causal systems, the limits on the sum are from k = 0 to 00 . This equation 
shows that the transfer function H[z\ is the 2 -transform of the impulse response 
h[k\ of an LTID system; that is 

M*1 «=* H[z\ (11.14) 

This important result relates the impulse response ft[k], which is a time-domain 
specification of a system, to H[z\, which is a frequency-domain specification of a 
system. The result is parallel to that for LTIC systems. 

A Exercise Ell. 4 

Redo Exercise E9.5 by taking the inverse z - transform of H\z\. V 


11.2 Some properties of the Z-Transform 

The 2 -transform properties are useful in the derivation of 2 -transforms of many 
functions and also in the solution of linear difference equations with constant coef- 
ficients. Here we consider a few important properties of the 2 -transform. 

Right Shift (Delay) 

If 

/[k]u[k] -t=t- F[z] 

then 

/[A: - l]u[fc — 1] <=> jF[z] (11.15a) 

and 

f[k - m]u[k - m] <=> ™F[z] (11.15b) 

f[k - l]u[fc] <=> ±F[z] + /[-!] 


and 


(11.16a) 



then 


f[k + l]u[fc] zFjz] — z/[0] 


(11.17a) 





I Example 11.4 

Find the z-transform of the signal f[k] depicted in Fig. 11.4. 

The signal /[fc] can be expressed as a product of k and a gate pulse u[k] — u[k — 6]. 

Therefore 


f[k ] — k {u[fc| — u[k — 6]} 
= Aru[fc] — ku[k — 6] 


i 
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We cannot find the ^-transform of ku[k - 6] directly by using the right-shift property [Eq. 
(11.15b)]. So we rearrange it in terms of (k - 6)u[k - 6] as follows: 

f[k\ = ku\k) - [(fc - 6)u[fc - 6] + 6u[fc - 6]] 

We can now find the z-transform of the bracketed term by using the right-shift property 
[Eq. (11.15b)]. Because u[fc] <=> 

t 1 z 1 

u [k -6] <(=> ~ Z S( Z - l) 

Also, because fcu[k] <=> 

1 z 1 

(k - 6)u[k - 6] <=*- — z 5 ( 2 _ 1)2 

Therefore 

r 1 z 1 6 

F[2] = (z - l) I 2 * * " z 5 (z-l) 2 ~ z*(z - 1) 

Z 6 — 6z + 5 M 

= z s( z -\y 

A Exercise El 1.5 

Using only the fact that u[fc] <=*• jfl and the right-shift property [Eq. (11.15)], find the 
z-transforms of the signals in Figs. 11.2 and 11.3. The answers are given in Example 11.2d and 
Exercise El 1.1a. V 

Convolution 

The time convolution property and the frequency convolution property state 
that if 

/j[k] Fi[z) and f 2 [k] <=> F 2 [z], 
then (time convolution) 

/i [fc] * / 2 [*] <=► Fi[z]F 2 [z] (11.18) 

and (frequency convolution) 

/i[fc]/ 2 [fc] ^ / Fl[u]F2 [«1 U_1 du {1119) 

Proof: These properties apply to causal as well as noncausal sequences. For 
this reason, we shall prove them for the more general case of noncausal sequences, 
where the convolution sum ranges from -oo to oo. To prove the time convolution, 
we have 

OO 

Z{h[k]* f 2 [k]} = Z Y! fk[m]f 2 [k-m] 

_m=— oo 
oo oo 

= z ~ k /lH/2[ fc - m l 

fc— — oo m=-oo 
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Interchanging the order of summation, 


0° OO 

Z[fi[k)*f 2 [k]}= E E f2[k-m}z~ k 

m—— oo k — — oo 

00 °° 

= E AM E 

m=—oc r=— oo 

oo °° 

= y , E 

m=— oo r=— oo 

= Fi[z]F2[z] 


To prove the frequency convolution, we start with 


2{/l[fc]/2[fc]}= E /iMAM* fc 

fc=— oo 



Interchanging the order of summation and integration 


-fc 


du 


LTID System Response 

It is interesting to apply the time convolution property to the LTID input- 
output equation y[k] = /[fc]*h[fc]. In Eq. (11.14), we have shown that h[k] < — > H [z]. 
Hence, according to Eq. (11.18), it follows that 


Y[z] = F[z}H[z] 


(11.20) 


Earlier in the chapter, we derived this important result using informal arguments. 


Multiplication by y k 
If 


then 


/[fc]u[fc] -»=$■ F[z] 
■y k f[k}u\k] F [- 


Proof: 

CX> 

2{ 7 fc /w«w} = E^/ W z ~ k 

k = 0 



( 11 . 21 ) 


A Exercise El 1.6 

Using Eq. (11.21), derive Pairs 7 and 8 in Table 11.1 from Pairs 2 and 3, respectively. V 

Multiplication by k (Scaling in the z-Domain 

If 

/[fc]«[fc] 4=> F[z] 

then , 

fc/[fc]u[k] <=* -z—F[z] (11.22) 

Proof: 


— z 




E/M z k 

k = 0 


-zY-vw k 1 

fc=0 


= ^k/[k]z- fc = 2{fc/[fc]uW} 

k = 0 


A Exercise Ell. 7 

Using Eq. (11.22), derive Pairs 3 and 4 in Table 11.1 from Pair 2. Similarly, derive Pairs 8 
and 9 from Pair 7. V 


Initial and Final Value 

For a causal /[fc], 

/[0] = lirn^ F[z] 


(11.23a) 


This result follows immediately from Eq. (11.9) 

We can also show that if (z - l)F(z) has no poles outside the unit circle, then 


lim f{N) = lim(z - l)F(z) (11.23b) 

TV— ► oo z—*\ 


11.3 Z-Transform Solution of Linear Difference Equations 

The time-shifting (left- or right-shift) property has set the stage for solving 
linear difference equations with constant coefficients. As in the case of the Laplace 
transform with differential equations, the z-transform converts difference equations 
into algebraic equations which are readily solved to find the solution in the z- 
domain. Taking the inverse z-transform of the z-domain solution yields the desired 
time-domain solution. The following examples demonstrate the procedure. 


I Example 11.5 

y[k + 2] - 5i /[k + 1] + 6y[fc] = 3/[fc + 1) + 5/[fc] (11-24) 

if the initial conditions are »[-l] = »[-2] = §, and the input /[fc] = (2)- fc «[fc]. 
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Table 11.2 


Z- Transform Operations 


Operation 

m 

F[z] 

Addition 

h[k] + /a[fc] 

Fi [z] + F 2 [z] 

Scalar multiplication 

a/[fc) 

aF[z] 

Right-shift 

f[k~ m]u[k — m] 



f[k - m]u[k] 

£*■[*] + ££/[-*: 

fc=i 


f[k - l]ti[/c] 

^W + ZI-i] 


f[k — 2]u[fc] 

^FW + i/[-l]+/[-2] 


f[k - 3]u[fc] 

iFW + l/[-l] + i/(-2] + /(-3] 

Left-shift 

f[k + m]u[k] 

m— 1 

z m F[z\ - z m /[*]*"* 

k= 0 


f[k + 1 \u[k\ 

N 

frt ' 

1 

N 

***»» 

O 


f[k + 2]u[fc] 

- z 2 /[0] - z/[ 1] 


}[k + 3]«[Jfc] 

z 3 F[z]-z 3 flO]-z 2 f{l]-zf[2] 

Multiplication by j k 

7 ,c /[fc]u[fc] 

F \ Z - 

.7 

Multiplication by A: 

kf[k]u[k] 


Time Convolution 

fi[k]*Mk] 

F\[z\Fi[z\ 

Frequency Convolution 

/ 1 W/ 2 W 

jij/F,[u]F 2 [f] u~ l du 

Initial value 

m 

linw_ co .F[z] 

Final value 

limjv-.oo /[A] 

lim z _i (2 — l)F[z] poles of 



(2 — ljFfz] inside the unit circle. 
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As we shall see, difference equations can be solved by using the right-shift or the left- 
shift property. Because the difference equation (11.24) is in advance-operator form, the 
use of the left-shift property in Eqs. (11.17a) and (11.17b) may seem appropriate for its 
solution. Unfortunately, as seen from Eqs. (11.17a) and (11.17b), these properties require a 
knowledge of auxiliary conditions y[0], y[l], ■ • • , y[n — 1] rather than of the initial conditions 
y[— 1], y[— 2], ■ • • , y[-n], which are generally given. This difficulty can be overcome by 
expressing the difference equation (11.24) in delay operator form (obtained by replacing k 
with k - 2) and then using the right-shift property.! Equation (11.24) in delay operator 
form is 

y[k] - 5 y[k - 1] + 6y[k - 2] = 3 /[* - 1] + 5/[fc - 2] (11.25) 

We now use the right-shift property to take the 2 -transform of this equation. But before 
proceeding, we must be clear about the meaning of a term like y[k — 1]. Does it mean 
y[k — l]u[fc — 1] or y[k — l]u[fc]? The answer becomes clear when we recognize that the 
use of the unilateral transform implies that we are considering the situation for k > 0, 
and that every signal in Eq. (11.25) must be counted from k = 0. Therefore, the term 
y[k — j] means y[k — j]u[k]. Remember also that although we are considering the situation 
for k > 0, y[fc] is present even before k = 0 (in the form of initial conditions). Now 

y[k]u[k] <=> Y[z) 

y[k - l]u[fc] <=> i Y[z] + y[-l] = ^Y[z] + y 

1 1 1 1 1 37 

y[k - 2]u[fc] 4=!- -^Y[z) + — 1 /[ — 1] + y[~2] = ^Y[z] + — + — 

Also 

/[*] = (2)“*«W = (2 _1 )Mk] = (O.S)Mfc] <=#• 


f{k - l]u[fc] 4 = S - \f[z\ + /[-l] = 1 — - — + °= ■ 1 

2 z z — U.5 z U.5 

f[k - 2 ]»[fc] 4=> ±F{z] + i/t-1] + /[— 2] = ±F[z] + 0 + 0 = ^ 
Note that for causal input f[k], 


/[-I] = /[-2] = - - - = /[-«] = 0 

Hence 

f[k - r]tt[fc] 4=^ ^r-F[z] 

Taking the 2 -transform of Eq. (11.25) and substituting the above results, we obtain 


[z]+ ‘6j +6 b 5 


r i 11 37 

[2l+ fo + 36 


z(z — 0.5) 


(11.26a) 




- 0.5 z(z - 0.5) 


(11.26b) 


f Another approach is to find y[0], y[l], y(2], ■ ■ • , y[n — 1] from y[— 1], y[— 2], • • * , y(— n] iteratively, as 
in Sec. 9.1-1, and then apply the left-shift property to Eq. (11.24) 




This example demonstrates the ease with which linear difference equations with 
constant coefficients can be solved by ^-transform. This method is general; it can 
be used to solve a single difference equation or a set of simultaneous difference 
equations of any order as long as the equations are linear with constant coefficients. 

Comment 

Sometimes auxiliary conditions y[0], t/[l], • • ■ , j/[n — 1] (instead of initial condi- 
tions 2/[— 1], y[— 2], • • ■ , y [ — n]) are given to solve a difference equation. In this case, 
the equation can be solved by expressing it in the advance operator form and then 
using the left-shift property (see Exercise El 1.9 below). 

A Exercise El 1.8 

Solve the equation below if the initial conditions are y[ — 1] — 2, y[— 2] = 0, and the input 
/[*] = «[*]: 

y[ fc + 2 ] - |y( fc + i] + gy[*! = 5/[fc + 1] - /[*] 

Answer: »[fc) = [l2 - 15(i) fc + U(i)*] «[*] V 
A Exercise El 1.9 

Solve the following equation if the auxiliary conditions are y[0] = 1, y[l] = 2, and the input 

flk] = 

y[k + 2] + 3 y[k + 1] + 2y[fc] = f[k + 1] + 3 f[k] 
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Answer: y[fc] = [§ + 2(-l) fc - § (— 2) fc ] u[fc) V 

Zero-Input and Zero-State Components 

In Example 11.5 we found the total solution of the difference equation. It is 
relatively easy to separate the solution into zero-input and zero-state components. 
All we have to do is to separate the response into terms arising from the input and 
terms arising from initial conditions. We can separate the response in Eq. (11.26b) 
as follows: 


(■-1+iK K) 


— - — + (11.29) 

z - 0.5 z(z - 0.5) v 


initial condition terms terms arising from input 


Therefore 


H + a) 


(3 z + 5) 
z(z — 0.5) 


initial condition terms input terms 


Multiplying both sides by z 2 yields 


(z 2 - 5z + 6) Y [z] = z(3z - 11) H 


z(3z + 5) 


initial condition terms 


input terms 


y[ 1 _ Z ( 3z ~ n ) . ^( 3Z + 5 ) 

z 2 — 5^+6^ (z — 0.5)(z 2 — 5z ■+■ 6) 

zero-input response zero-state response 


(11.30) 


We expand both terms on the right-hand side into modified partial fractions to yield 

-M - [• (;h) - 2 (rrj)] + [I (H«) - f ( 7h) * f (^i)] 


y[k]= 5(2) fc -2(3) fc -f(2)' £ + f(3)' £ + f|(0.5)' : «[fc] 


= [-|(2) fc + f( 3 )' ; + l!( 0 - 5 )1 u W 

a conclusion, which agrees with the result in Eq. (11.28). 

A Exercise Ell. 10 
Solve 

y\ k + 2 1 - §y[ fc + il + gy[ fc l = 5 /t fc + 1] - /W 

if the initial conditions are y[-l] = 2, y[-2] = 0, and the input f[k] = «[*]. Separate the response 
into zero-input and zero-state components. 
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Answer: 



11.3-1 Zero-State Response of LTID Systems: The Transfer Function 

Consider an nth-order LTID system specified by the difference equation 

Q[E)y{k} = P[E]}[k) (11.31a) 

or 

(E n + a n -iE n 1 + ■ • • + aiE + ao)t/[fc] = 

(b n E n + fcn-iS"- 1 + • ■ ■ + biE + *o)/[*I (11.31b) 

or 

y[k + n] + a n _iy[k + n — 1] + - • • + ai y[k + 1] + aoy[fc] 

= b n f[k + n] + • ■ ■ + bif[k + 1] + 6o/[fcj (11.31c) 

We now derive the general expression for the zero-state response; that is, the system 
response to input f[k] when all the initial conditions y [— 1] = y[- 2] = • • • = y[-n] = 
0 (zero state). The input f[k] is assumed to be causal so that / [ — 1] = /[— 2] = 
••• = /[-n] = 0. 

Equation (11.31c) can be expressed in the delay operator form as 

y[k\ + a„_i 2 /[fc - 1] -) + ao?/[A: - n] 

= bn }[k] + b n —if[k - 1] + • • • + b 0 f[k - n] (11.31d) 
Because y[-r ] = f[—r] = 0 for r = 1, 2, . . . , n 

y\k — m]u[fc] -^T[z] 

f[k - m]u[k ] <b=b F[z ] m = 1, 2, ...,n 

Now the z-transform of Eq. (11.31d) is given by 


+ + + - +j5)r|.] = (*. + tl + ^ + -+£)fW 


Multiplication of both sides by z n yields 

(z n + a n - 1 z n ~ 1 + ■ ■ ■ + aiz + ao)K[z] 

= ( b n z n + 6 n _iz" 1 -b • • ■ + biz + 6q)E[z] 
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Y [z] = F[z]H[z] 


Fig. 11.5 The transformed representation of an LTID system. 


Therefore 


_ f b„z n + bn-i-g" 1 -I h 

\ z n + a n _iz n_1 H ha 


b\z + bo 
1 2 + a 0 


(11.32) 


(11.33) 


We have shown in Eq. (11.20) that Y[z] = F \z]H [z ] . Hence, it follows that 

„r i B[z] ^ b n z n + b n -iz n 1 + ■ • • + biz + bo 


Q[z] z n + a n _jz n-1 H b a\z + t 


(11.34) 


As in the case of LTIC systems, this result leads to an alternative definition of 
the LTID system transfer function as the ratio of Y[z] to F[z] (assuming all initial 
conditions zero). 


, - _ Y[z] _ 2 [zero-state response] 
E[z] 2 [input] 


(11.35) 


Because Y[z], the z-transform of the zero-state response y[fc], is the product 
of F[z\ and H[z\, we can represent an LTID system in the frequency domain by 
a block diagram, as illustrated in Fig. 11.5. Just as in continuous-time systems, 
we can represent discrete-time systems in the transformed manner by representing 
all signals by their z-transforms and all system components (or elements) by their 
transfer functions. 

Observe that the denominator of H [z] is <5[z], the characteristic polynomial of 
the system. Therefore the poles of H[z ] are the characteristic roots of the system. 
Consequently, the system stability criterion can be stated in terms of the poles of 
the transfer function of an LTID system as follows: 

1. An LTID system is asymptotically stable if and only if all the poles of its 
transfer function H{z) lie inside a unit circle (centered at the origin) in the 
complex plane. The poles may be repeated or unrepeated. 

2. An LTID system is unstable if and only if either one or both of the following 
conditions exist: (i) at least one pole of H [z] is outside the unit circle; (ii) there 
are repeated poles of H[z\ on the unit circle. 


3. An LTID system is marginally stable if and only if there are no poles of H [z] 
outside the unit circle, and there are some unrepeated poles on the unit circle. 
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/[*] U[k 1 

1 

/[t-lj u [t-l] 

Uzl 

Z 

_ rui=I Ffz] 


z 


Fig. 11.6 Ideal unit delay and its transfer function. 

I Example 11.6: The Transfer Function of a Unit Delay 
Show that the transfer function of a unit delay is 1/z. 

If the input to the unit delay is /[fc]u[fc], then its output (Fig. 11.6) is given by 
y[k] = f[k - l]u[fc - 1] 

The z-transform of this equation yields [see Eq. (11.15a)] 

Y\*\ = ;#■[*] 

= H[z]F{z\ 

It follows that the transfer function of the unit delay is 

H \A = \ (11.36) 



(11.37) 
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so that 


and 


-( 2 1 

8 f Z ) 1 »( 2 "l 

3 \z + 0.2/ 

3 Vz + 0.8/ ’ “ Vz + 0.5/ 


«/[*] = [§(— 0.2) fc - §(-0.8)* + 2(— 0.5)*] u[fc] ■ 


(11.38) 


O Computer Example C11.3 

Solve Example 11.7 using MATLAB. Plot y[lt] for 0 < k < 10. 


k=0:10; 
b=[0 1 0.32]; 
a=[l 1 0.16]; 
f=(-2).-(-k); 
y=filter(b,a,f); 
stem(k,y) 

xlabel(’k’);ylabel(’y[k]’) Q 


A Exercise Ell. 11 

A discrete-time system is described by the following transfer function: 

H[z ] = 

(z + 0.5)(z - 1) 

(a) Find the system response to input f[k] = 3~( fc+1 > u [fc] if all initial conditions are zero, (b) 
Write the difference equation relating the output j/[fc] to input /[A:] for this system. 

Answers: (a) j/[*] = § ^ - 0.8(~0.5) k + 0.3 (§)*J u[fc] 

(b) y\k + 2] - 0.5y[fc + 1] - 0.5y[fc] = f\k + 1] - 0.5/[fc] V 


11.4 System Realization 


We now discuss ways to realize an nth-order discrete-time system described by 
a transfer function 


~b b n -\z n 1 + ■ • • + b\z + bp 
z n + o n _i z n_1 H b aiz + ao 


(11.39) 


This transfer function is identical to the general nth-order continuous-time transfer 
function H(s) in Eq. (6.70) with s replaced by z. It is reasonable to believe that the 
realization of H\z ] in (11.39) would be identical to that of H(s) with s replaced by 
z. Fortunately this happens to be the case. In realizations of H(s) the basic element 
used was an integrator with transfer function 1/s. In realizations of H[z\ the basic 
element is unit delay with transfer function 1/z. Therefore, all the realizations of 
H ( s ) studied in Sec. 6.6 are also the realizations of H [z] if we replace integrators 
by unit delays. To demonstrate this point, consider a realization of a third-order 
transfer function. 


b 3 Z 3 + b 2 z 2 + 6iz + bo 
z 3 + 02 z 2 + oiz + a o 


(11.40) 


Figure 11.7 shows Fig. 6.21 with all the integrators (with transfer function 1/s) 
replaced with unit delays (with transfer function 1/z). We shall now show that this 
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Fig. 11.7 A canonical realization of H[z], 


realization indeed represents H[z] in Eq. (11.40). Let the signal at the output of 
the third delay be X[z]. Consequently, signals at the inputs of the second and the 
first delay are zX[z] and z 2 A[zj. The first summer output z 3 X[z] is equal to the 
sum of the four inputs to that summer. Therefore 


z 3 X[z] = -a 2 z 2 X[z] - aizX[z] - a 0 X[z] + f [z] 


so that 


(z 3 + a 2 z 2 + a lZ + a 0 )X[z] = F[z] (11.41) 

Moreover, Y[z], the output of the second summer, is equal to the sum of four signals 
to that summer. Therefore 


Y[z] = (b 3 z 3 + b 2 z 2 + biz + 6 0 )X[z] (11.42) 

From Eqs. (11.41) and (11.42), it follows that 

Y[z] _ b 3 z 3 + b 2 z 2 + b\z + bo 
F[z\ z 3 + a 2 z 2 + aiz + ag 


This result shows that Fig. 11.7 is indeed a realization of H[z\ in Eq. (11.40). Sim- 
ilarly, the cascade and parallel realizations of the continuous-time case are directly 
applicable to discrete-time systems, with integrators replaced by unit delays. The 
second canonical realization developed in Appendix 6.1 also applies to discrete-time 
case with 1/s replaced by 1/z. 
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I Example 11.8 

Realize the following transfer functions, using only the cascade form for part a and 
using only the parallel form for part b. 


4z + 28 


7z 2 + 37z + 51 


"W = TO^5< b > "M= (z + 2)( z + 3 )2 

Identical transfer functions for continuous-time systems are realized in Figs. 6.27 and 
6.28. ■ 

A Exercise Ell. 12 

2 z - j- 8 

Give the canonical realization of the following transfer functions, (a) (b) 

, x 2z + 3 2 + 5 2 + 5 

C z + 5 z 2 + 6z + 25 


Answer: See Example 6.18. Replace 1/s by 1/z and make appropriate changes in coefficients. 


V 


11.5 Connection between the Laplace and the Z-Transform 

We now show that discrete-time systems also can be analyzed using the Laplace 
transform. In fact, we shall see that the z-transform is the Laplace transform in 
disguise and that discrete-time systems can be analyzed as if they were continuous- 
time systems. 

So far we have considered the discrete-time signal as a sequence of numbers 
and not as an electrical signal (voltage or current). Similarly, we have considered a 
discrete-time system as a mechanism that processes a sequence of numbers (input) 
to yield another sequence of numbers (output). The system was built by using 
delays (along with adders and multipliers) that delay sequences of numbers, not 
electrical signals (voltages or currents). A digital computer is a perfect example: 
every signal is a sequence of numbers, and the processing involves delaying sequences 
of numbers (along with addition and multiplication). 

Consider a discrete-time system with transfer function H[z ] and an input f[k], 
as shown in Fig. 11.8a. We can think of (or generate, for that matter) a correspond- 
ing continuous-time signal f(t) consisting of impulses spaced T seconds apart. Let 
the fcth impulse of strength be f[k\ as depicted in Fig. 11.8b. Thus 

OO 

/W = £/[*]£(«-«’) (11.43) 

fc =0 

Figure 11.8 shows f[k j and corresponding /(<). Let us now consider a system 
identical in structure to the discrete-time system with transfer function H[z], except 
that the delays in H [z] are replaced by elements that delay continuous-time signals 
(such as voltages or currents). If a continuous-time impulse S(t) is applied to such 
a delay of T seconds, the output will be 6(i — T). The continuous-time transfer 
function of such a delay is e~ sT [see Eq. (6.54)]. Hence, the delay elements with 
transfer function 1/z in the realization of H [z] will be replaced by the delay elements 
with transfer function e~ sT in the realization of the corresponding H (s). This step is 
the same as z being replaced by e sT . Therefore, the transfer function of this system 
is H[z] with z replaced by e sT . Thus H ( s ) = H[e sT ]. Now whatever operations are 
performed by the discrete-time system H[z\ on f[k] (Fig. 11.8a) are also performed 
by the corresponding continuous-time system H\e sT j on the impulse sequence f(t) 
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Fig. 11.8 Connection between the Laplace and z-transform. 

(Fig. 11.8b). The delaying of a sequence in H\z] would amount to the delaying 
of an impulse train in H[e sT ]. The case of adding and multiplying operations is 
similar. In other words, one-to-one correspondence of the two systems is preserved 
in every aspect. Therefore, if y[fc] is the output of the discrete-time system in Fig. 
11.8a, then y(t), the output of the continuous-time system in Fig. 11.8b, would be 
a sequence of impulses whose k th impulse strength is y[fc]. Thus 


$(0 = !>[*]*(*- *T) (11-44) 

k=0 

The system in Fig. 11.8b, being a continuous-time system, can be analyzed by using 
the Laplace transform. If 

/(f) <=> F(s) and y(t) -f=t- F(s) 

then 

K(s) = tf[e sT ]F(s) (11.45) 


Also 

OO 

F(s) = C £/[*]. 6(t-kT) 
,k= 0 

Now, because the Laplace transform of 6(t — kT) is e“ 

OO 

-skT 


Similarly 


F(s) = ^f[k]e 

fc =0 


y(») = 


(11.46) 


(11.47) 


Substitution of Eqs. (11.46)and (11.47) in Eq. (11.45) yields 


]Ty[fc]e 


£/m. 


fc =0 


By introducing a new variable z = e sT , this equation can be expressed as 

OO CO 


fc =0 

F[z] = tf[z]F[z] 


where 


F[z] = ^/[fc]z k and F[z) = ^y[fc]« * 


fc= o 




It is clear from this discussion that the z-transform can be considered as a Laplace 
transform with a change of variable z = e sT or s = (1/T) lnz. On the other hand, 
we may consider the z-transform as an independent transform in its own right. 
Note that the transformation z = e sT transforms the imaginary axis in the s-plane 
(s = jijj) into a unit circle in the z-plane (z = e sT = e JwT , or |z| = 1). The LHP 
and RHP in the s-plane map into the inside and the outside, respectively, of the 
unit circle in the z-plane. 


11.6 Sampled-data (Hybrid) Systems 

Sampled-data systems are hybrid systems consisting of discrete-time as well 
as continuous-time subsystems. Consider, for example, a fire control system. In 
this case, the problem is to search and track a moving target and fire a projectile 
for a direct hit. The data obtained from the search and tracking radar is discrete- 
time data because of a scanning operation, which results in sampling of azimuth, 
elevation, and the target velocity. This data is now fed to a digital (discrete-time) 
processor, which performs extensive computations. The computer output is then 
fed to a continuous-time plant, such as a gun mount, which accordingly positions 
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Discrete-time Continuous-time 

controller plant 



Fig. 11.9 Typical sampled-data systems. 

itself at a certain position and fires. Another example is attitude-control problem 
in a spacecraft, where the information about the actual spacecraft attitude is fed 
back to a digital processor, which generates corrective input to be applied to the 
spacecraft, which is a continuous-time system. In automatic periodic quality check 
in production line, the discrete-data obtained from the periodic check, after some 
digital processing, generates the corrective input to be applied to a continuous-time 
plant. In complex control systems, use of digital processor as a controller or a 
compensator for continuous-time plants is growing rapidly. 

In time-sharing systems, where, for economic reasons, certain facilities are 
shared by several systems, the signals are, by nature, discrete-time or sampled. 
In regulator type control systems, where an output variable must be maintained 
at a constant value, the external disturbance and plant parameters variations are 
usually so slow that continuous monitoring (or feedback) is unnecessary. It is ade- 
quate to sample the output periodically and then feed back this discrete-data. In 
such cases, feedback transducers, data-processing facilities and possibly long and 
expensive feedback communication facilities can be shared among several control 
systems. 

Figure 11.9 shows some typical sampled-data systems. Figure 11.9a contains 
a digital processor, whereas in Fig. 11.9b, the sampled signal is directly applied to 
D/A converter (the hold circuit) without further digital processing. Figure 11.9c 
shows a practical system, where the input signal itself is a discrete-time signal 
/[&], and the sampler is in the feedback path. This system is equivalent to that 
in Fig. 11.9b. How do we analyze such hybrid systems, where continuous-time and 
discrete-time signals intermingle? An effective strategy in such a situation is to 
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relate the samples of the output to those of the input. But, this procedure yields 
information about the output only at sampling instants. We can overcome this 
difficulty by taking the samples at instants in between samples using the modified 
z-transform as explained later. 

In sampled-data systems, the discrete-time signals are often obtained as a result 
of sampling continuous-time signals. These samples are narrow pulses, which may be 
considered as impulses, provided the pulse width is small compared to the system 
time constant. Thus, in the following discussion, a discrete-time signal, when it 
appears in conjunction with a continuous-time system, is a sequence of impulses 
rather than a sequence of numbers. Hence, a discrete-time signal f[k } can also be 
considered as continuous-time signal /(f), where 

/(<) = £/ [*]«(* -*T) 

k 

Observe an interesting fact: in this representation a discrete-time unit impulse 
6 [A:] is the continuous-time unit impulse 6(f). Thus, at the input of a discrete-time 
processor, a discrete-time signal f[k] is just a sequence of numbers. But at the input 
of a continuous-time system, f[k] is a sequence of impulses. There are appropriate 
converters at the interface of discrete-time and continuous-time systems to carry 
out signal conversion to appropriate forms. 

To begin with, consider a basic continuous-time system (Fig. 11.10a) with 
transfer function H(s). The input /(f) is sampled and the sampled signal f[k] is 
applied to the input of H ( s ). Although y(t), the output of this system, is continuous, 
we shall endeavor to find the values of y(t) only at the discrete instants t = kT. 
Such an analysis is relatively simple using the method of z-transform. For this 
purpose, we consider as if the output is sampled by an hypothetical sampler shown 
dotted in Fig. 11.10a. Now, we shall relate the input samples f[k] and the output 
samples y[k]. Let h[k\ be the unit impulse response relating the output samples 
to the input samples. In other words, y[k\ = h[k] * f[k]. Recall also that an unit 
impulse S[k] is S(t) when considered in conjunction with a continuous-time system. 
Hence, h[k], the unit impulse response is the sampled version of the system’s unit 
impulse response h(t). Thus, 


h[fc] = h(kT) 

where T is the sampling interval. For instance, if H(s) = then h(t) = e Xt and 

h[k] = e xkT 

Therefore, the equivalent discrete-time transfer function H [z] of this system is given 

by 


H\z\ = Z{h[k}} 

= Z[e XkT ] 

= -~xr (U-«) 
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Fig. 11.10 Computing the output in hybrid or sampled-data systems. 

Thus, H[z\ is the discrete-time transfer function of H ( s ) = T+X that relates y[k] 
(the output samples) to the discrete-time input /[ft]. f 

If we have two systems with transfer functions G(s) and H(s) in cascade (Fig. 
11.10b), the equivalent transfer T[z\ / G[z]H [z], but is GH[z], where G[z], H [z] and 
GH[z] correspond to discrete-time transfer functions of G(s), H(s) and G(s)H(s), 
respectively. For instance, if 

G{s) = — and H{s) = - 

S “T 2 S 

Then, according to Eq. (11.49) 

G[z] = and H M = 

z — e z — L 

However, the continuous-time system transfer function is G(s)H(s), where 

<=<•>*<*> = - 5 


1 3__ 

S 5 4-2 


And from Eq. (11.49) 


fUsing this procedure, we have listed H(s) and corresponding H[z] in Table 12.1 in Chapter 12. 
In this Table, H[z] is multiplied with a scaling factor T, which results in H[z] = z ^\t - Eor the 
purpose of the sampled data application, the extra factor T should be ignored throughout in Table 
12 . 1 . 
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TU -5 (rh - 7^) * C W"W 

In this case, we use the notation GH[z) for T[z]. Thus, GH[z\ ^ G[z)H{z\, but is 
the discrete-time transfer function which corresponds to G(s)H ( s ). 

For the system in Fig. 11.10c, 

Y[z] = H\z\X[z\ = H[z]G[z]F[z] so that T\z\ = G[z\H{z\ 

For the system in Fig. ll.lOd, 

E[z) = F[z } - W[z] 

Moreover, 


Hence 


Consequently 


W[z} = H{z]Y[z] 

Y[z] = G\z]E[z} 

= G[z] (F[z}-W[z\) 

= G[z}(F{z\-H[z}Y[z\) 


T[zl = 


G[z] 


1 + G[z]H [z] 


Flzl 


T[z\ = 


CM 

1 + G[z]H[z] 


I Example 11.9 

Find the output samples y[k] for the sampled-data system illustrated in Fig. 11. 11a 
when the input is a unit step function u(t), the sampling interval T = 0.5 second and 

Gc[z] = and G(s) = 

This system has a discrete-time controller and a continuous-time plant. f To find the 
transfer function of this system, we observe that 


Y[z] = G[z]X[z], X[z] = G c [z]E[z], and E[z] = F[z\ - Y [z] 

Hence 


Y[z)=Gc[z]G[z](F[z]-Y[z]) 

and the system transfer function T[z] is 

Y[z\ = G c [z]G[z] 

1 J F\z) 1 + G c [z]G[z] 


| The block diagram in Fig. 11. 11a does not show the appropriate converters required at the 
interface of discrete-time and continuous-time systems; these are implied. Thus, the output of the 
sampler, which consists of impulse sequence, is converted into sequence of numbers to act as the 
input to the discrete- time controller. Similarly, the output of a discrete-time controller, which is 
a sequence of numbers, is converted to a sequence of impulses to act as an input to the plant. 









11.6 Sampled-Data (Hybrid) Systems 


703 


Hence 

^ 0.5832 0.083z 

Y ' Z '~ z- 1 z - 0.394 + 2-0. 174 

and 

y[fc] = 1 - 0.583(0. 394) + 0.083(0.174)* 

This response is depicted in Fig. 11.11. I 

11.6-1 Response Between Sampling Instants: The Modified Z-Transform 


The above analysis yields the output only at sampling instants. We can readily 
find the response between successive sampling instants by using the modified z- 
transform. This goal can be accomplished by considering the response at another 
set of sampling instants t = (k + p)X, where 0 < p < 1. 

Consider the system in Fig. 11.10a with H (s) = 1 / (s — A ) . The impulse response 
is h(t) — e xt and its samples at instants t = (k + p)T are 

h(t, p) = e A ( fc+fl)T = e x,,T [e AW "] (11.50a) 

The corresponding 2 -transfer function is 


H[z, p] = e A '' r - 


(11.50b) 


In this manner, We can prepare a table of modified z-transform. When we use 
H[z, p] instead of H[z] in our analysis, we obtain the response at instants t = 
( k + fi)T . By using different values of p in the range 0 to T, we can obtain the 
complete response y(t). 


I Example 11.10 

Find the output y{t) for all ( in Example 11.9. 

In Example 11.9, we found the response y[fc] only at the sampling instants. To 
find the output values between sampling instants, we use the modified z-transform. The 
procedure is the same as before, except that we use modified z-transform corresponding 
to continuous-time systems and signals. For the system G(s) = 1/s + 4 with T = 0.5, the 
modified z-transform [Eq. (11.50b) with A = —4, and T = 0.5] is 


H[z, n] = e A " T - 


Moreover to find the modified z-transform corresponding to f(t) = u(t) [A — 0 in Eq. 
(11.50a)], we have F\z, p] = z/(z - 1). Substitution of these expressions in those found in 
Example 11.9, we obtain 


z 0.583z , 0.083z ’ 

z-1 ~ 2 - 0.394 + z - 0.174. 


Y\z, p] = 


,- 2(1 
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From Eqs. (11.50), we obtain the inverse (modified) z-transform of this equation as 

y[(k + n)T] = e -2|J [l - 0.583(0.394)'' + 0.083(-0.174) fc ] 0 < /x < 1 

The complete response is also shown in Fig. 11.11. I 

Design of Sampled-Data Systems 

As with continuous-time control systems, sampled-data systems are designed to 
meet certain transient (PO, f r , t s , etc.) and steady-state specifications. The design 
procedure follows along the lines similar to those used for continuous-time systems. 
We begin with a general second-order system, the relationship between closed- 
loop pole locations and the corresponding transient parameters PO, t r , are 

determined. Hence, for a given transient specifications, an acceptable region in the 
z-plane where the dominant poles of the closed-loop transfer function T[z] should 
lie is determined. Next, we sketch the root locus for the system. The rules for 
sketching the root locus are the same as those for continuous-time systems. If the 
root locus passes through the acceptable region, the transient specifications can be 
met by simple adjustment of the gain K. If not, we must use a compensator, which 
will steer the root locus in the acceptable region. 


11.7 The Bilateral Z-Transform 

Situations involving noncausal signals or systems cannot be handled by the 
(unilateral) z-transform discussed so far. Such cases can be analyzed by the bilat- 
eral (or two-sided) z-transform defined by 

OO 

*■[*] = E W z ~ k 

k=~ oo 

The inverse z-transform is given by 

These equations define the bilateral z-transform. The unilateral z-transform dis- 
cussed so far is a special case, where the input signals are restricted to be causal. 
Restricting signals in this way results in considerable simplification in the region of 
convergence. Earlier, we showed that 

■y k u[k] <=> |zj > |-y | (11.51) 

z - 7 

In contrast, the z-transform of the signal -7 k u[-(k + 1)], illustrated in Fig. 11.12a, 
is 
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Fig. 11.12 + 1)] and the region of convergence of its z-transform. 



Z + 1)]} = E- = E- 0* 



Therefore 

2 {-7 fc u[-(fc + 1)]} = — — \z\ < |7| (11.52) 

z — 7 

A comparison of Eqs. (11.51) with (11.52) shows that the z-transform of 7 k u[k] is 
identical to that of —"f k u[—(k + 1)]. The regions of convergence, however, are dif- 
ferent. In the former case, F[z\ converges for |z| > I7 1 ; in the latter, F[z] converges 
for |z| < I7I (see Fig. 11.12b). Clearly, the inverse transform of F[z] is not unique 
unless the region of convergence is specified. If we restrict all our signals to be 
causal, however, this ambiguity does not arise. The inverse transform of z/(z — 7) 
is 7 k u[k] even without specifying the region of convergence. Thus, in the unilat- 
eral transform, we can ignore the region of convergence in determining the inverse 
z-transform of F[z]. 

fl Example 11.11 

Determine the z-transform of 

f[k] = (0.9) fc u[fc] + (1.2)*u[-(fc + 1)] 

= h[k] + f2[k] 
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Fig. 11.13 Signal f[k] for Example 11.11. 


From the results in Eqs. (11.51) and (11.52), we have 

= |2|>0 ' 9 

F2W= ^h w <x - 2 

The common region where both Fi[z] and F 2 [z\ converge is 0.9 < \z\ < 1.2 (Fig. 11.13a). 
Hence 



H Example 11.12 

Find the inverse ^-transform of 


f[ 2 ] = 


-z(z + 0.4) 

(z - 0.8)(z - 2) 


if the region of convergence is (a) |z| > 2 (b) |z| < 0.8 (c) 0.8 < |z| < 2. 


F[z] = — (z + 0.4) 

z _ (z - 0.8)(z - 2) 

1 2 

z — 0.8 z — 2 


and 


F M = rra8~ 2 ^2 
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-10 -5 0 5 10 


(c) 

Fig. 11.14 Three possible inverse transforms of F[z] in Example 11.12. 

Since the region of convergence is |z| > 2, both terms correspond to causal sequences and 

f[k] = [(0.8)* - 2(2)*] u[k] 

This sequence appears in Fig. 11.14a. 

(b) In this case, \z\ < 0.8, which is less than the magnitudes of both poles. Hence, 
both terms correspond to anticausal sequences, and 

/[*] = [-( 0 - 8 )* + 2 ( 2 )*] «[-(* + 1 )] 

This sequence appears in Fig. 11.14b. 

(c) In this case, 0.8 < i*i < 2; the part of F[z] corresponding to the pole at 0.8 is a 
causal sequence, and the part corresponding to the pole at 2 is an anticausal sequence: 

/[*] = (0.8)*u[fc) + 2(2)*u[-(fc + 1)] 


This sequence appears in Fig. 11.14c. 
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A. Exercise El 1.13 

Find the inverse z-transform of 




5 > M > 5 


Answer: 6( — g) fc ti[fcj + 6(-l) fc u[-(k + 1)] v 

Inverse Transform by Expansion of F[z] in Power Series of z 

We have 


i = £/w* 


For an anticausal sequence, which exists only for A; < — 1, this equation becomes 
F[z] = f[-\)z + /[— 2]z 2 + /[— 3]z 3 + ■ ■ ■ 

We can find the inverse z-transform of F[z] by dividing the numerator polynomial 
with the denominator polynomial, both in ascending powers of z, to obtain a poly- 
nomial in ascending powers of z. Thus, to find the inverse transform of z/(z - 0.5) 
(when the region of convergence is |z| < 0.5), we divide z with -0.5 + z to obtain 
— 2z - 4z 2 - 8z 3 - ■ ■ ■. Hence, /[-l] = -2, /(- 2] = -4, /[-3] = -8 and so on. 

11.7-1 Analysis of LTID Systems Using the Bilateral 2-Transform 

Because the bilateral z-transform can handle noncausal signals, we can analyze 
noncausal linear systems using this transform. The zero-state response y[fc] is given 

by 

y[A] = Z~ 1 {F[z]tf(z]} 

provided that F[z\H\z ] exists. The region of convergence of F{z]H[z\ is the region 
where both F[z] and H[z] exist, a fact which means that the region is common to 
the convergence of both F[z] and H[z). 

■ Example 11.13 

For a causal system specified by the transfer function 


find the zero-state response to input 

f[k] = (0.8) fc ii[fc] + 2(2) k u[-(k + 1)] 

The z-transform of this signal is found from Example 11.12 (part c) as 


T[z] = F[z]H\z\ = 


— z 2 (z + 0.4) 

(z - 0.5)(z - 0.8)(z - 2) 


Therefore 




no 
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and 

y\k] = yi[k\+y 2 {k] 

= [f (0.5)* + f (0.8) fc ] u{k] + 6(0.6) fc u[— (fc + 1)] ■ 

A Exercise El 1.14 

For a causal system in Example 11.13, find the zero-state response to input 
/[*]= (i)*«[fcj + 5(3) fc «[-(fc + 1)] 

Answer: [-(I)* + 3(1)*] u\k] + 6(3) fc u(-(k + 1)] y 

11.8 Summary 

In this chapter we discuss the analysis of linear, time-invariant, discrete-time 
(LTID) systems by z-transform. The z-transform is an extension of the DTFT 
with the frequency variable jfi generalized to a + jCt. Such an extension allows us 
to synthesize discrete-time signals by using exponentially growing (discrete-time) 
sinusoids. The relationship of the z-transform to the DTFT is identical to that of 
the Laplace transform to the Fourier. Because of the generalization of the frequency 
variable, we can analyze all kinds of LTID systems and also handle exponentially 
growing inputs. 

The z-transform changes the difference equations of LTID systems into alge- 
braic equations. Therefore, solving these difference equations reduces to solving 
algebraic equations. 

The transfer function H[z] of an LTID system is equal to the ratio of the z- 
transform of the output to the z-transform of the input when all initial conditions 
are zero. Therefore, if F[z] is the z-transform of the input f[k] and Y[z] is the 
z-transform of the corresponding output y[k] (when all initial conditions are zero), 
then T[z] = H [z]F[z], For a system specified by the difference equation <3[F]p[k] = 
P[E]/[fc], the transfer function H [z] = P[z}/Q\z). Moreover, H [z| is the z-transform 
of the system impulse response h[k}. We also showed in Chapter 9 that the system 
response to an everlasting exponential z k is H\z)z k . 

LTID systems can be realized by scalar multipliers, summers, and time delays. 
A given transfer function can be synthesized in many different ways. Canonical, 
cascade and parallel forms of realization are discussed. The realization procedure 
is identical to that for continuous-time systems. 

In Sec. 11.5, we showed that discrete-time systems can be analyzed by the 
Laplace transform as if they were continuous-time systems. In fact, we showed that 
the z-transform is the Laplace transform with a change in variable. 

In practice, we often have to deal with hybrid systems consisting of discrete- 
time and continuous-time subsystems. Feedback hybrid systems are also called 
sampled-data systems. In such systems, we can relate the samples of the output to 
those of the input. However, the output is generally a continuous-time signal. The 
output values during the successive sampling intervals can be found by using the 
modified z-transform. 

The majority of the input signals and practical systems are causal. Conse- 
quently, we are required to deal with causal signals most of the time. When all 
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signals are restricted to the causal type, the z-transform analysis is greatly simpli- 
fied; the region of convergence of a signal becomes irrelevant to the analysis process. 
This special case of z-transform (which is restricted to causal signals) is called the 
unilateral z-transform. Much of the chapter deals with this transform. Section 
11.7 discusses the general variety of the z-transform (bilateral z-transform), which 
can handle causal and noncausal signals and systems. In the bilateral transform, 
the inverse transform of F[z] is not unique, but depends on the region of conver- 
gence of F[z]. Thus, the region of convergence plays a crucial role in the bilateral 
z-transform. 


Problems 

11.1-1 Using the definition of the z-transform, show that 


(a) y k l u[k — 1] ■ 


(b) u[k - m] 


z m (z - 1) 


( c ) -jjjulfc] 4=4- 

(J , (In a) fc ri , 

( d ) 


11.1- 2 Using only the z-transform Table 11.1, show that 

(a) 2 k+ 'u{k - 1] + e k ~\[ k] ^ ^ 

(b) ky k u[k - 1] «=> j -2*— 

(z - 7 Y 

Hint: Express u[k - 1] in terms of u[fc). 

(c) 

Hint: See the hint for part b. 

(d) k(k — l)(fc - 2)2 k ~ 3 u[k - m] <==> f° r m= 0> b 2, or 3. 

Hint: Examine what happens to the function if u[k - m] is replaced by u[Jfc], 

11.1- 3 Find the inverse z-transform of 


z(z - 4) 
z 2 — 5z 4- 6 

(g) 

z — 4 


z 2 — 5z + 6 

(h) 

(e' 2 - 2)z 
(z-e-*)(z-2) 

(i) 

z(2z + 3) 

(z — l)(z 2 - 5z + 6) 

(j) 

z(— 5z + 22) 

(z + l)(z-2) 2 

(k) 


m z(1.4z + 0.08) 

' (z — 0.2)(z — 0.8) 2 

11.1-4 Find the first three terms of f[k] if 


z(z — 2) 
z 2 — z + 1 


2 z‘ - 0.3z + 0.25 


z 2 + 0.6z - 

f 0.25 

2z(3z 

- 23) 

(z - l)(z 2 

- 6z + 25) 

z(3.83z - 

f 11.34) 

(z - 2)(z 2 ■ 

- 5z + 25) 

z 2 (— 2z 2 + 

8z - 7) 

(z-l)(z 

-2) 3 


= rl 


2z 3 + 13z 2 + z 
z 3 + 7z 2 + 2z + 1 
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Fig. Pll.2-1 Fig. PI 1.2-2 


11 . 1-5 


11 . 2-1 


Find your answer by expanding F[z] as a power series in z 1 . 
By expanding 

as a power series in z _1 , show that /[fc] = fc 7 fc tt[fc]. 

For a discrete-time signal shown in Fig. Pll.2-1 show that 



11.2- 2 Find the z-transform of the signal illustrated in Fig. Pll.2-2. Solve this problem in 

two ways, as in Examples 11. 2d and 11.4. Verify that the two answers are equivalent. 

11.2- 3 Using only the fact that 7 k u[fc] <=> and properties of the z-transform, find the 

z-transform of 

(a) k 2r i k u\k\ (c) a k [u[fc] - u[fc - m]] 

(b) fc 3 u[fc] (d) ke~ 2k u\k — m\ 

11-2-4 Using only Pair 1 in Table 11.1 and appropriate properties of the z-transform, derive 
iteratively pairs 2 through 9. In other words, first derive Pair 2. Then use Pair 2 
(and Pair 1, if needed) to derive Pair 3, and so on. However, pair 6 should be derived 
after pair 7. 

11.3- 1 Solve Prob. 9.4-9 by the z-transform method. 

11.3- 2 Solve 

y[fc + 1] + 2y[fc] = f[k 4- 1] 
with y[0] = 1 and f[k] = e -( * _1) u[fc] 

11.3- 3 Find the output y[fc] of an LTID system specified by the equation 

2y[fc + 2] - 3y[fc + 1] + y[k) = 4 /[fc + 2] - 3/[fc + 1) 

if the initial conditions are y[— 1] = 0, y[-2] = 1, and the input f[k] = (4)~ fc u[fc]. 

11.3- 4 Solve Prob. 11.3-3 if instead of initial conditions y[— l],y[— 2] you are given the aux- 

iliary conditions y[0] = | and y[l] = 

11.3- 5 Solve 

4y(fc + 2j + 4y[fc + 1] + y[fc] = /[fc + 1] 

with y[-l] = 0, y [— 2] = 1, and /[fc] = u[fc], 

11.3- 6 Solve 


y[k + 2] - 3y[fc + 1] + 2y\k] = f[k + 1] 
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if y [ — 1] = 2, y [ — 2] = 3, and /(fc] = (3)*u[fcj. 

Solve 

y[k + 2] - 2y[fc + 1] + 2y[fc] = f[k] 
with y [ — 1] = 1, y[ — 2] = 0, and /[fc] = u[fc]. 

Solve 

y[fc] 4- 2y[fc - 1) + 2y[k - 2] = f[k - 1] + 2 f[k - 2] 
with y(0] = 0, y[l] = 1, and /[fc] = e k u[k\. 

(a) Find the zero-state response of an LTID system with transfer function 

= (z + 0.2)(z — 0.8) 

and the input /[fc] = e* k+1 'u[fc[. 

(b) Write the difference equation relating the output y [fc] to input /[fc]. 
Repeat Prob. 11.3-9 if /[fc] = u[fc] and 


Repeat Prob. 11.3-9 if 


(z - 2)(z - 3) 


6(5z - 1) 


1 J 6z 2 - 5z + 1 

and the input /[fc] is (a) (4)~*u[fc] (b) (4)~^ _2 *u[fc - 2] (c) (4)~**~ 2 'u[fc] 
(d) (4)-*u[k -2]. 

Repeat Prob. 11.3-9 if /[fc] = u[fc] and 


11 z 2 — 1.6z + 0.8 

Find the transfer functions corresponding to each of the systems specified by difference 
equations in Probs. 11.3-2, 11.3-3, 11.3-5, and 11.3-8. 

Find fc[fc], the unit impulse response of the systems described by the following equa- 
tions: 

(a) y [fc] + 3y[fc - 1] + 2y[fc - 2] = /[fc] + 3/[fc - 1] + 3/[fc - 2] 

(b) y[fc + 2] + 2y[fc + 1] + y[fc] = 2/[fc + 2] - /[fc + 1] 

(c) y[fc] - y[fc - 1] + 0.5y [fc - 2] = /[fc] + 2/[fc - 1] 

Find h[fc], the unit impulse response of the systems in Probs. 11.3-9, 11.3-10, and 

11.3-12. 

Show a canonical, a cascade and a parallel realization of the following transfer func- 
tions: 

rrf-i _ z(3z - 1-8) 


< a) "M= z 2 -z + 0.16 

rr < , 5z + 2.2 
(b) H[Z] = z 2 + z + 0.16 
n , _ 3.8z - 1.1 

(C) ( 2 _ o 2)(z 2 _ 0 6z + o 25 ) 

Give cascade and parallel realizations of the following transfer functions: 


z(1.6z - 1.8) 

( z — 0.2 )(z 2 + z + 0.5) 


z(2z 2 + 1.3z + 0.96) 
(z + 0.5)(z — 0.4) 2 
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Fig. Pll.6-1. 



Fig. PI 1.6-2. 



11.6- 1 Determine y[k], the output samples for the system depicted in Fig. Pll.6-1 if the 

input f(t) = e~ 2t u{t). 

11.6- 2 For the sampled-data system in Fig. Pll.6-2, show that the ^-transfer function is 


where the transfer function GH[z\ corresponds to G{s)H{s) in Table 12.1. 

11.6-3 For the sampled-data system in Fig. Pll.6-3, show that the output Y[z] is given by 


Y \A = 


FG\A 

1 + GH[z] 


Note that FG[z] corresponds to the entry for F(s)G(s) in Table 12.1. It is not the 
same as F[z]G[z). In this case, it is not possible to express the output as Y[z ] = 
T[z]F[z}. Consequently, the z-transfer function of such systems does not exist, and 
their analysis is little more complicated. 
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Fig. Pll.6-3. 


11.7- 1 Find the z-transform (if it exists) and the corresponding region of convergence for 

each of the following signals: 

(a) (0.8)*u[fc] + 2 k u[—(k + 1)] 

(b) 2*u[fc] - 3*u[-(k + 1)] 

(c) (0 ,8)*u[fc] + (0.9)*uj— (At + 1)] 

(d) [(0.8)* + 3(0.4)*] u[-(k + 1)] 

(e) [(0.8)* + 3(0.4)*] u[k] 

(f) (0.8)*u[fc] + 3(0.4)*u[-(fc + l)] 

11.7- 2 Find the inverse z-transform of 

Flz] _ (e~ 2 ~ 2) g 

11 “ (« - e- 2 )(* - 2 ) 

when the region of convergence is 

(a) |z| > 2 (b) e~ 2 < \z\ < 2 (c) |z] < e' 2 . 

11.7- 3 Determine the zero-state response of a system having a transfer function 


(z + 0.2)(z — 0.8) 


|z| > 0.8 


and an input f[k] given by 

(a) /[fc] = e*u[fc] 

(b) f[k] = 2*u[— (fc + 1)] 

(c) f[k] = e*u[fc] + 2*u[— (fc + 1)] 

H,7_4 For the system in Problem 11.7-3, determine the zero-state response if the input 

/[fc] = 2*u[fc] + u[— (fc + 1)] 

11.7-5 For the system in Problem 11.7-3, determine the zero-state response if the input 

f[k] = e~ 2k [—(k + 1)] 
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Frequency Response and 
Digital Filters 


Filtering characteristics of a system are specified by its frequency response. For 
this reason it is important to study frequency response of discrete-time systems, 
which is very similar to the frequency response of continuous-time systems with 
some significant differences. 

12.1 Frequency Response of Discrete-Time Systems 

For (asymptotically stable) continuous-time systems we showed that the system 
response to an input e iut is H (ju)e ]uje , and that the response to an input cos wf is 
\H (joi)| cos [u)t + lH(ju)\. Similar results hold for discrete-time systems. We now 
show that for an (asymptotically stable) LTID system, the system response to an 
input e jnfc is /f [e jf! ]e jS!fc and the response to an input cos ilk is |//[e jn ]| cos (ilk + 
L H[e jn \ ). 

The proof is similar to the one used in continuous-time systems. In Sec. 9.4-2 
we showed that an LTID system response to an (everlasting) exponential z k is also 
an (everlasting) exponential H{z\z k . It is helpful to represent this relationship by 
a directed arrow notation as 

z k =$. H[z\z k (12.1) 

Setting z = e ±jCi in this relationship yields 

e ink =>H[e i!i }e i(lk (12.2a) 

e~ jnk => H[e- in ]e- jak (12.2b) 

Addition of these two equations yields 

2 cos ilk =* H[e j(l ]e ink + H{e^ n \e^ nk = 2Re [e ,n ]e , ' nfc ^ (12.3) 

Expressing H[e* a ] in the polar form 

H[e ja ] = \H[e in \\e ilH ^ (12.4) 

Eq. (12.3) can be expressed as 


cos Qk \H[e jn }\ cos (ilk + lH[e jC, ]j (12.5) 

In other words, the system response y[k] to a sinusoidal input cos Hfc is given by 

y[fc] = |ff [e jf! ]| cos (ilk + lH[e jn ^J (12.6a) 

Following the same argument, the system response to a sinusoid cos (ilk + 6 ) is 

y[k] = \H[e iCl }\ cos (ilk +6 + (12.6b) 

This result applies only to asymptotically stable systems because Eq. (12.1)js vahd 
only for values of z lying in the region of convergence of H[z}. For z = e J , z lies 
on the unit circle (|z| = 1). The region of convergence for unstable and marginally 
stable systems does not include the unit circle. 

This important result shows that the response of an asymptotically stable LTID 
system to a discrete-time sinusoidal input of frequency f2 is also a discrete-time sinu- 
soid of the same frequency. The amplitude of the output sinusoid is | [e jn ]Mimes 
the input amplitude, and the phase of the output sinusoid is shifted by lH[eJ il ] with 
respect to the input phase. Clearly |H[e-> n ]| is the amplitude gain, and a plot of 
|iT [e jn )| versus fl is the amplitude response of the discrete-time system. Similarly, 
lH[e jCl ] is the phase response of the system, and a plot of lH\e jU ] vs il stows 
how the system modifies or shifts the phase of the input sinusoid. Note that H [e jn ] 
incorporates the information of both amplitude and phase response and therefore 
is called the frequency response of the system. 

These results, although parallel to those for continuous-time systems, differ 
from them in one significant aspect. In the continuous-time case, the frequency re- 
sponse is H(ju). A parallel result for the discrete-time case would lead to frequency 
response H[jil). Instead, we found the frequency response to be H [e jil \. This devi- 
ation causes some interesting differences between the behavior of continuous-time 
and discrete-time systems. 

Steady-State Response to Causal Sinusoidal Input 

As in the case of continuous-time systems, we can show that the response of an 
LTID system to a causal sinusoidal input cos ilku[k] is y[k] in Eq. (12.6a), plus a 
natural component consisting of the characteristic modes (see Prob. 12.1-4). For a 
stable system, all the modes decay exponentially, and only the sinusoidal component 
in Eq. (12.6a) persists. For this reason, this component is called the sinusoidal 
steady-state response of the system. Thus, y ss [fc], the steady-state response of a 
system to a causal sinusoidal input cos fi/cu[fc], is 

y ss {k} = \H\e*]\cos(nk + lH[e^ 

System Response to Sampled Continuous-Time Sinusoids 

So far we have considered the system response of a discrete-time system to a 
discrete-time sinusoid cos ilk (or exponential e^ k ). In practice, the input may be a 
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Fig. 12.1 Frequency response of an LTID system in Example 12.1 


Figure 12.1 shows plots of amplitude and phase response as functions of Cl. We now 
compute the amplitude and the phase response for the various inputs: 

(a) m = l k = 1 

Since l k = (e jCi ) k with fl = 0, the amplitude response is H[e?°\. From Eq. (12.8a) 
we obtain 


H[e j0 ] = ■ 


/l.64 - 1.6 cos (0) 


; = 5 = 5Z0 


Therefore 


|H[e j0 ]| = 5 and LH [e’ 0 ] = 0 


These values also can be read directly from Figs. 12.1a and 12.1b, respectively, correspond- 
ing to Cl - 0. Therefore, the system response to input 1 is 


y[k] = 5(l fc ) = 5 


( 12 . 10 ) 


(b) f[k] = cos[ffc - 0.2) 

Here fl = f . According to Eqs. (12.8) 
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Fig. 12.2 Sinusoidal input and the corresponding output of an LTID system in Example 
12 . 1 . 


y [Ac] = 1.983 cos (ffc - 0-2 - 0.916) 

= 1.983 cos (f k - 1.116) (12.11) 

Figure 12.2 shows the input f[k] and the corresponding system response. 

(c) A sinusoid cos 1500£ sampled every T seconds (t = kT) results in a discrete-time 
sinusoid 

f[k ] = cos 1500fcT (12.12) 

For T = 0.001, the input is 

f[k] = cos (1.5fc) (12.13) 

In this case, Cl ~ 1.5. According to Eqs. (12.8a) and (12.8b) 

= 0.809 (12.14) 

lH{e jl - 5 ] = - tan " 1 , = -°- 702 rad ( 1215 ) 

1 J 1 - 0.8 cos (1.5) 

These values also could be read directly from Fig. 12.1 corresponding to Cl = 15. 
Therefore 

y [Ac] = 0.809 cos (1.5fc — 0.702) ■ 


/l . 64 - 1.6 cos (1.5) 


Q Computer Example C12.1 

Using MATLAB, find the frequency response of the system in Example 12.1. 
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num=[l 0]; den=[l -0.8]; 

W=-pi:pi/100:pi; 

H=freqz(num,den,W); 

mag=abs(H); 

phase= 180 /pi*unwrap(angle(H)); 

subplot(2,l,l); 

plot ( W ,mag) ;grid; 

subplot(2,l,2); 

plot ( W .phase) ;grid Q 

Comment ( n 

Figure 12.1 shows plots of amplitude and phase response as functions ot U. 

These plots as well as Eqs. (12.8) indicate that the frequency response of a discrete- 
time system is a continuous (rather than discrete) function of frequency 9. There 
is no contradiction here. This behavior is merely an indication of the fact that the 
frequency variable 0 is continuous (takes on all possible values) and therefore the 
system response exists at every value of Cl. 

A Exercise E12.1 

For a system specified by the equation 

y[k + lj - 0.5y[fc] = /[*:] 

find the amplitude and phase response. Find the system response to sinusoidal input cos (lOOOt- J ) 
sampled every T — 0.5 ms. 

AnSWen iHle^l-Trab™ ZH[^]:=-tan-> [ 3 ^] 

y\k\ = 1.639 cos (0.5Ac - § - 0.904) = 1.639 cos (0.5Ac - 1.951) V 

A Exercise E12.2 

Show that for an ideal delay (H[z] = 1/z), the amplitude response \H[e> ]| = 1, and the 
phase response lH\e> a ] = -ft. Thus, a pure time-delay does not affect the amplitude gam of 
sinusoidal input, but it causes a phase shift (delay) of fi radians in a discrete sinusoid of frequency 
Q. Thus, in the case of an ideal delay, we see that the phase shift at the output is proportional to 
the frequency of the input sinusoid (linear phase shift). V 

The Periodic Nature of the Frequency Response 

Figure 12.1 shows that for the system in Example 12.1, the frequency response 
H[e jn ] is a periodic function of 9 with period 2w. This fact is not a coincidence. 
Unlike the frequency response of a continuous-time system, the frequency response 
of every LTID system is a periodic function of 9 with period 2 tt. This fact fol- 
lows from the very structure of the frequency response Its argument e 

is a periodic function of Q with period 2 tt. This fact will automatically render 
H[e jnk ] periodic. There is a physical reason for this periodicity and the periodicity 
of H [c jnfc ] should not come as a surprise. We know that discrete-time sinusoids sep- 
arated by values of 9. in integral multiples of 2 * are identical. Therefore, the system 
response to such sinusoids (or exponentials) is also identical. Thus for discrete- time 
systems, we need to plot the frequency response only over the frequency range from 
- 7 T to ir (or from 0 to 2 jt). In a real sense, discrete-time sinusoids of frequencies 
outside the fundamental range of frequencies do not exist (although they exist in a 
technical sense). 
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(b) 



12.2 Frequency Response From Pole-Zero Location 


lines connecting z\, z 2 , . . z n to the point e ^ T . Similarly, let <Ji , d 2 , • ■ -,d n be fbe 
lengths and 0i, 0 2 , .... 0„ be the angles, respectively, of the lines connecting 71 . 72, 
■ • ., In to e? wT ■ Then 


H[e j “ T ] = H[z]\ z=ei „ T 


{d ie ^)(d 2 e^) ■ ■ ■ (d n e^) 


r\r 2 --r n j[(^ 1 +*+ -+ 0 „)-(#i+# 2 +- -+«n)l 

n dld 2 •••<!„* 


(12.17) 

(12.18) 


Therefore 


|R[e^ T ]| = b n 


rir 2 ■ • r n 
d\d 2 ■ ■ ■ d n 


product of the distances of zeros to e jwT 

1 + ..f 


(12.19a) 


and 

lH[e iuT ] = {<t>l + <t>2 + ' ' • ’Pn) - (»1 + e 2 + ■ ■ ■ + 9 n ) 

= sum of zero angles to e juT - sum of pole angles to e JwT (12.19b) 


Fig. 12.3 (a) vector representation of complex numbers (b) vector representation of 

factors of H[z\. 


12.2 Frequency Response From Pole-Zero Location 

The frequency response (amplitude and phase response) of a system are deter- 
mined by pole-zero locations of the transfer function H[z). Just as in continuous- 
time systems, it is possible to determine quickly the amplitude and the phase re- 
sponse and to obtain physical insight into the filter characteristics of a discrete-time 
system by using a graphical technique. Consider the transfer function 


(f - fl )(z - Z 2 ) ■ ■ ■ (z - Zn) 

(z - 7 i)(z - 72 ) • •• (z - 7n) 


(12.16) 


We can compute H[z] graphically using the concepts discussed in Sec. 7.3. The 
directed line segment from zj to z in the complex plane (Fig. 12.3a) represents the 
complex number z - The length of this segment is |z - z,| and its angle with the 
horizontal axis is L(z — Zi). 

In filtering applications, the inputs are often the sampled continuous-time sinu- 
soids. Earlier, we showed that a sampled continuous-time sinusoid cos ut appears 
as a discrete-time sinusoid cos flk (fl = uT). The appropriate function for com- 
puting the frequency response in such a situation, therefore, is H[e^ uT ] (H = uT). 
To compute the frequency response H[e^ u,T ] we evaluate H [z] at z = . But for 

z = e JwT , |z| = 1 and Zz = uT so that z = e J ' U,T represents a point on the unit circle 
at an angle uiT with the horizontal. We now connect all zeros (zi, z 2 , . . ., z n ) and 
all poles ( 71 , 7 2 , . . ., j n ) to the point e jujT , as indicated in Fig. 12.3b. Let n, r 2 , 
. . ., r n be the lengths and <h, <t> 2 , • ■ •, 4>n be the angles, respectively, of the straight 


In this manner, we can compute the frequency response H [e JuT ] for any value of u> 
by selecting the point on the unit circle at an angle uiT corresponding to that value 
of uj. This point is e iwT . In summary, to compute the frequency response H 1 > 

we connect all poles and zeros to this point and determine |R[e ^ 3 ]| and Z//|e JUJ ] 
using the above equations. We repeat this procedure for all values of uiT from 0 to 
it to obtain the frequency response. 

Controlling Gain by Placement of Poles and Zeros 

The nature of the influence of pole and zero locations on the frequency response 
is similar to that observed in continuous-time systems with a minor difference. In 
place of the imaginary axis of the continuous-time systems, we have a unit circle in 
the discrete-time case. The nearer the pole (or zero) is to a point e^ T (on the unit 
circle) representing some frequency u, the more influence that pole (or zero) wields 
on the amplitude response at that frequency because the length of the vector joining 
that pole (or zero) to the point e juT is small. The proximity of a pole (or zero) has 
similar effect on the phase response. From Eq. (12.19a), it is clear that to enhance 
the amplitude response at a frequency u, we should place a pole as close as possible 
to the point e ]hjT (on the unit circle) representing that frequency u>. Similarly, to 
suppress the amplitude response at a frequency w , we should place a zero as close 
as possible to the point e j “ T on the unit circle. Placing repeated poles or zeros will 
further enhance their influence. 

Total suppression of signal transmission at any frequency can be achieved by 
placing a zero on the unit circle at a point corresponding to that frequency. This is 
the principle of the notch (bandstop) filter. 

Placing a pole or a zero at the origin does not influence the amplitude response 
because the length of the vector connecting the origin to any point on the unit 
circle is unity. However, a pole (a zero) at the origin generates angle -uiT (uT) in 






Fig. 12.5 Designing a bandpass filter in Example 12.2. 


place a pole in its vicinity (near e Because this is a complex pole we also need its 
conjugate near e ~J ir / 4 j as indicated in Fig. 12.5a. Let us choose these poles Ai and X 2 as 

Aj = |7|e’ ,r/4 and A 2 = | 7 |e“ j,r/4 

where I7I < 1 for stability. The closer the value of |-y| is to the unit circle, the more sharply 
peaked is the response around u> = 2507T. We also have a zeros at ±1. Hence 

H [ z 1 _ K ~ ^ + 11 - = (12.20) 

(z - |7|e J,r / 4 )(z - |7|e ■b'/ 4 ) z 2 - V2\qr\ z + I7I 2 

For convenience we shall choose K — 1. The amplitude response is given by 


\e j2u,T - 1| 

|e > >T - h|e^/ 4 | \e’" T - |7|e"^/ 4 | 


Now, using Eq.(12.9), we obtain 


| m >r ,| 2 2(1 - cos 2 ujT) 

1 1 11 [l + M 2 - 2| 7 | cos (uT — f )] [l + | 7 | 2 — 2| 7 | cos (wT + f )] 


(12.21) 
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Figure 12.5b shows the amplitude response for values of I7I = 0.83, 0.96, and 1. As 
expected, the gain is zero at u, = 0 and at 500 Hz (w = lOOOx). The gain peaks at about 
125 Hz (w = 250 tt). The resonance (peaking) becomes pronounced as hi approaches 1. 
Fig. 12.5c shows a canonical realization of this filter [see Eq. (12.20)]. B 

Q Computer Example C12.2 

Using MATLAB, find the frequency response of the bandpass filter in Example 12.2 
for hi = 0.96. 

gamma=0.96; 

num=[l 0 -1]; den=[l -sqrt(2)*gamma gamma‘2]; 

W=-pi:pi/100:pi; 

H=freqz(num,den,W); 

mag=abs(H); 

phase=180/pi*unwrap(angle(H)); 

subplot(2,l,l) 

plot(W,mag) 

subplot(2,l,2) 

plot (W, phase) Q 


■ Example 12.3: Notch (Bandstop) Filter 

Design a second-order notch filter to have zero transmission at 250 Hz and a sharp 
recovery of gain to unity on both sides of 250 Hz. The highest significant frequency to be 
processed is J~h = 500 Hz. 

In this case, T < 1/2 Th = 10~ 3 . Let us choose T = 10 . For the frequency 

250 Hz, u>T — 2tr(250)T = ir/2. Thus, the frequency 250 Hz is represented by a point 
e> wT = e W2 = j on the unit circle, as depicted in Fig. 12.6a. Since we need zero 
transmission at this frequency, we must place a zero at z = e r " /2 = j and its conjugate at 
z - = -j. We also require a sharp recovery of gain on both sides of frequency 250 

Hz. To accomplish this goal, we place two poles close to the two zeros in order to cancel 
out the effect of the zeros as we move away from the point j (corresponding to frequency 
250 Hz). For this reason, let us use poles at ±ja with a < 1 for stability. The closer the 
poles are to the zeros (the closer the a to 1), the faster is the gain recovery on either side 
of 250 Hz. The resulting transfer function is 

HIi]=k ±zm±$. = k4^ 

1 1 (z - ja)(z + ja) z 2 + o 2 
The dc gain (gain at uj ~ 0, or z — 1 ) of this filter is 


H[l] = K- 


Because we require a dc gain of unity, we must select K = LbS- . The transfer function is 

therefore , , w , , 

H i z] - (l + « )( 2 +1) (12.22) 

2(z 2 + a 2 ) 

and according to Eq. (12.9) 


| tf [ e j “ r ]| 2 = 


(1 + a 2 ) 2 (e 22 " T + l)(e- j2wT + 1) (1 + a 2 ) 2 ( l + cos 2 ujT) 

4 ( e j 2 wT + a 2 )(e~i 2 “ T + a 2 ) 2(1 + a 4 + 2a 2 cos 2u)T) 
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Fig. 12.6 Designing a notch (bandstop) filter in Example 12.3. 

Figure 12.6b shows \H[e jujT ]\ for values of a = 0.3, 0.6, and 0.95. Figure 12.6c shows 
a realization of this filter. I 

A Exercise E12.3 

Using the graphical argument, show that a filter with transfer function 

acts as a highpass filter. Make a rough sketch of the amplitude response. v 
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12.3 Digital Filters 

Digital filters and some of their advantages were discussed in Sec. 8.5. Digital 
filters can be classified as either recursive or nonrecursive. 


Recursive Filters 

The terms recursive and nonrecursive are easily understood in terms of a spe- 
cific example. Consider a third-order system with the transfer function 


63Z 3 + b 2 z 2 + b\z + fro 
Z 3 + U 2 Z 2 + CL\Z + do 


(12.23) 


The input f[k] and the corresponding output y\k] of this system are related by the 
difference equation. 


y[fc] + a 2 y[k — 1] + oiy[fc — 2] + aoy[k — 3] — 

63/]^] + l>2 f[k - 1] + bif[k - 2] + baf[k — 3] (12.24a) 

or 

y[k] = -a 2 y\k - 1] - aiy[k - 2] - aoy\k - 3]^ 

V V ^ 

output terms 

+ 63/ [fe] + i>2 /[k - 1] + t>if[k — 2] + bof[k - 3], (12.24b) 

N 1 “ ■ V " " 

input terms 

Here y[fc], the output at instant k, is determined by the input values f[k], f[k - 1], 
f[k - 2], and f[k - 3] as well as by the past output values y\k - 1], y\k - 2], and 
y [k - 3], The output is therefore determined iteratively or recursively from the its 
past values. To compute the present output of this third-order system, we use the 
past three values of the output. In general, for an nth-order system we use the past 
n values of the output. Such a system is called a recursive system. 

An interesting feature of a recursive system is that once an output exists, it 
tends to propagate itself forever because of its recursive nature. This is also seen 
from the canonical realization of H[z] in Fig. 12.7a. Once an input (any input) is 
applied, the feedback connections loop the output continuously back into the system, 
and the output continues forever. This propagation of the output in perpetuity 
occurs because of the nonzero values of coefficients ao, 01 , «-2, • • “n-i- These 
coefficients [appearing in the denominator of H [z] in Eq. (12.23)] are the recursive 
coefficients. The coefficients 60, f>i, b 2 , ■ ■ b n (appearing in the numerator of 
H [z]) are the nonrecursive coefficients. If an input 6[fc] is applied at the input 
of a recursive filter, the response h\k\ will continue forever up to k = 00. For this 
reason, recursive filters are also known as infinite impulse response (HR) filters. 
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(b) 

Fig. 12.7 Digital filter realization: (a) recursive filter (b) nonrecursive filter. 

Nonrecursive Filters 

If the recursive coefficients ao, a j, and 02 are zero, H[z] in Eq. (12.23) reduces 
to 



(12.25a) 

(12.25b) 


y[k] = 63 /[*] + b 2 f[k - 1] + bif[k - 2] + bof[k - 3] (12.26) 

Note that yjfc] is now computed from the present and the three past values of the 
input /[*]. Such filters are called nonrecursive filters. Figure 12.7b shows a 
canonical realization of H[z], which is identical to the realization in Fig. 12.7a, with 
all the feedback connections eliminated. If we apply an input /[*] = b[fc] to this 
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system, the input will pass through the system and will be completely out of the 
system by k = 4. There are no feedback connections to perpetuate the output. 
Therefore, h[k] will be nonzero only for fc = 0,1, 2, and 3. For an nth-order 
nonrecursive filter, h[k] is zero for k > n. Therefore, the duration of h[k] is finite for 
a nonrecursive filter. For this reason, nonrecursive filters are also known as finite 
impulse response (FIR) filters. Nonrecursive filters are a special case of recursive 
filters, in which all the recursive coefficients ao, aj, a 2 , . . ., a n _i are zero. 

An nth-order nonrecursive filter transfer function is given by (ao = aj = a 2 = 
■ ■ ■ = a„- 1 = 0). 


b n z n + bn-xz"" 1 + ■ • • + fel* + bp 


, 1 bl I b ° 

- bn + * + z 2 + + z"- 1 z n 


The inverse z-transform of this equation yields 


(12.27a) 

(12.27b) 


hi*] = 6 n b[fc] + 6 n _ib[fc - 1] + • ■ • + bx<5[* - n + 1] + b 0 b[* - n] (12.28) 
Observe that h[k] = 0 for fc > n. 

Because nonrecursive filters are a special case of recursive filters, we expect the 
performance of recursive filters to be superior. This expectation is true in the sense 
that a given amplitude response can be achieved by a recursive filter of an order 
smaller than that required for the corresponding nonrecursive filter. However, noil- 
recursive filters have the advantage of having linear phase characteristics. Recursive 
filters can realize linear phase only approximately. 

12.4 Filter Design Criteria 

A digital filter processes discrete-time signals to yield a discrete-time output. 
Digital filters can also process analog signals by converting them into discrete-time 
signals. If the input is a continuous-time signal f(t), it is converted into a discrete- 
time signal /[*] = f(kT) by a C/D (continuous-time to discrete-time) converter. 
The signal f[k] is now processed by a “digital” (meaning discrete-time) system with 
transfer function H[z}. The output y[k] of H\z] is then converted into an “analog” 
(meaning continuous-time) signal y(t). The system in Fig. 12.8a, therefore, acts as 
a continuous-time (or “analog”) system. Our objective is to determine the “digital” 
(discrete-time) processor H [z] that will make the system in Fig. 12.8a equivalent to 
a desired “analog” (continuous-time) system with transfer function H a {s), shown 
in Fig. 12.8b. 

We may strive to make the two systems behave similarly in the time-domain or 
in the frequency-domain. Accordingly, we have two different design procedures. Let 
us now determine the equivalence criterion of the two systems in the time-domain 
and in the frequency-domain. 

12.4-1 The Time-Domain Equivalence Criterion 

By time-domain equivalence we mean that for the same input /(t), the output 
y(t) of the system in Fig. 12.8a is equal to the output y{t) of the system in Fig. 
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Fig. 12.8 Analog filter realization with a digital filter. 


12.8b. Therefore y(kT), the samples of the output in Fig. 12.8b, are identical to 
y[k], the output of H\z\ in Fig. 12.8a. 

The output y(t) of the system in Fig. 12.8b isf 

y{t) = f f(r)h a (t - t) d.r 
J — OO 

An integral is a sum in the limit. Therefore, the above equation can be expressed 
as 

oo 

y(t) = lim ^ /(roAr)h a (f - mAr)Ar (12.29a) 

m—~ oo 

For our purpose it is convenient to use the notation T for Ar in the above equation. 
Such a change of notation yields 

OO 

y(t ) = lim T Y f(™T)h a {t - mT) (12.29b) 

m=— oo 

The response at the fcth sampling instant is y(kT) obtained by setting t — kT in 
the above equation: 

OO 

y(fcT) = lim T Y f{mT)h a [(k - m)T } (12.29c) 

m=— oo 

In Fig. 12.8a, the input to H[z\ is f{kT) = f[k]. If h[k ] is the unit impulse response 
of H [z], then y[k], the output of H[z\, is given by 

OO 

y[k)= Y /[m]ft[fc-m] (12.30) 

m ~— oo 

(For the sake of generality, we are assuming a noncausal system. The argument and the results 
are also valid for causal systems. 
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If the two systems are to be equivalent, y(kT) in Eq. (12.29c) must be equal to y[fc] 
in Eq. (12.30). Therefore 

= bin Th a {kT) (12.31) 

This is the time-domain criterion for equivalence of the two systems, according to 
this criterion, /i[fc], the unit impulse response of H [z] in Fig. 12.8a, must be equal 
to T times the samples of h a (t), the unit impulse response of the system in Fig. 
12.8b, assuming that T — * 0. This is known as the impulse invariance criterion 
of filter design.) 

12.4-2 The Frequency- Domain Equivalence Criterion 

In Sec. 2.4-3 [Eq. (2.47)], we proved that for an analog system with transfer 
function H a (s), the system response y{t) to the everlasting exponential input f(t) = 
e st is also an everlasting exponential 

y(t) = H a (s)e st (12.32) 

Similarly, in Eq. (9.57a), we showed that for a discrete-time system with transfer 
function H [z], the system response y{k] to an everlasting exponential input }[k] = z k 
is also an everlasting exponential H[z\z k \ 

y[k} = H[z]z k (12.33) 

If the systems in Figs. 12.8a and 12.8b are equivalent, then the response of both 
systems to an everlasting exponential input /(f) = e st should be the same. A 
continuous-time signal /(f) = e st sampled every T seconds results in a discrete- 
time signal 

f[k] = e skT 

= z k with z = e sT 

This discrete-time exponential z k is applied at the input of H [z] in Fig. 12.8a, whose 
response is 

y[ fc ] = H[z\z k \ z=e . T 

= H[e sT ]e skT (12.34) 

Now, for the system in Fig. 12.8b, y(kT), the fcth sample of the output y(t) in Eq. 
(12.32), is 

y{kT) = H a (s)e skT (12.35) 

If the two systems are to be equivalent, a necessary condition is that y[k\ in Eq. 
(12.34) must be equal to y{kT) in Eq. (12.35). This condition means that 

H[e sT ] = H a (s) (12.36) 

This is the frequency-domain criterion for equivalence of the two systems. It should 
be remembered, however, that with this criterion we are ensuring only that the 


f Because T is a constant, some authors ignore the factor T, which yields alternate criterion 
h[k] = h a {kT). Ignoring T merely scales the amplitude response of the resulting filter. 
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digital filter’s response matches exactly that of the desired analog filter at sampling 
instants. If we want the two responses to match at every value of t, we must have 
T — * 0. Therefore 

Urn H[e sT ] = H a (s) (12.37) 

A Practical Difficulty 

Both of these criteria for filter design require the condition T — > 0 for real- 
izing a digital filter equivalent to a given analog filter. However, this condition is 
impossible in practice because it necessitates an infinite sampling rate, resulting 
in an infinite data rate. In practice, we must choose a small but nonzero T to 
achieve a compromise between the two conflicting requirements, namely closeness 
of approximation and system cost. 

This approximation, however, does not mean that the system in Fig. 12.8a 
is inferior to that in Fig. 12.8b, because often H a (s) itself is an approximation 
to what we are seeking. For example, in lowpass filter design we strive to design 
a system with ideal lowpass characteristics. Failing that, however, we settle for 
some approximation such as Butterworth lowpass transfer functions. In fact, it is 
entirely possible that H[z], which is an approximation to H a (s), may be a better 
approximation to the desired characteristics than is H a (s) itself. 

12.5 Recursive Filter Design by the Time-Domain Criterion: 
The Impulse Invariance Method 

The time-domain design criterion for the equivalence of the systems in Figs. 
12.8a and 12.8b is [see Eq. (12.31)] 

h[k] = lim Th a (kT) (12.38) 

T— *0 

where h\k} is the unit impulse response of H\z], h a (t) is the unit impulse response 
of H a (s), and T is the sampling interval in Fig. 12.8a. 

As indicated earlier, it is impractical to let T — > 0. In practice, T is chosen 
to be small but nonzero. We have already discussed the effect of aliasing and the 
consequent distortion in the frequency response caused by nonzero T. Assuming 
that we have selected a suitable value of T, we can ignore the condition T — > 0, and 
Eq. (12.38) can be expressed as 

h[k] = Th a (kT) (12.39) 

The 2 -transform of this equation yields 

H[z]=Tz(h a {kT)j (12.40) 

This result yields the desired transfer function H[z\. 

Let us consider a first-order transfer function 


$ — A 


(12.41a) 
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Fig. 12.9 Procedure for the impulse invariance method of filter design. 


The impulse response h(t) of this filter is the inverse Laplace transform of H a (s), 
which in this case is 

h a (t) = ce M u(t) (12.41b) 

The corresponding digital filter unit sample response h[fc] is given by Eq. (12.39) 

h[k] = Th a (kT) = Tce kxT (12.42) 

Figures 12.9a and b show h a (t) and h\k\. According to Eq. (12.40), H\z] is T times 
the 2 -transform of h[k]. Thus, 

(1243) 

The procedure of finding H [ 2 ] can be systematized for any nth-order system. First 
we express an nth-order analog transfer function H a (s) as a sum of partial fractions 
as 

*.M- Ettt (12 ' 44) 

Then the corresponding H[z\ is given by 

< 12 - 45) 

t=i 

This transfer function can be readily realized as a parallel combination of the n first- 
order systems if all the n poles of H a (s) are real. The complex conjugate poles, if 
any, must be realized as a single second-order term. Table 12.1 lists several pairs of 
H a (s) and their corresponding H[z}. 

Choosing the Sampling Interval T 

If '}' h is the highest frequency to be processed, then the sampling interval must 
be no greater than 1/2 T h in order to avoid signal aliasing. However, in the impulse 
invariance method, there is yet another consideration, which must also be taken into 
account. Consider a hypothetical frequency response H a (ju) (Fig. 12.10a) that we 
wish to realize using a digital filter, as illustrated in Fig. 12.8a. Let us assume that 
we have an equivalent digital filter that meets the time-domain equivalence criterion 
in Eq. (12.37); that is , 
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Fig. 12.10 Aliasing in digital filters, and a choice of the sampling interval T. 


h\k] = Um Th a (kT) 

In Chapter 5 (Fig. 5.6), we showed that the Fourier transform of the samples of h a (t) 
consists of periodic repetition of H a (jv) with period equal to the sampling frequency 
u, = 2tt/T = 2-kTs-] Also HJjuj) is not generally bandlimited. Hence, aliasing 
among various repeating cycles cannot be prevented, as depicted in Fig. 12.10b. The 
resulting spectrum will be different from the desired spectrum, especially at higher 
frequencies. If H a (jw) were to be bandlimited; that is, if H a {ju) = 0 for |w| > u 0 , 
then the overlap could be avoided if we select the period 27 r/T > 2u>o- However, ac- 
cording to the Paley- Wiener criterion [Bq. (4.61)], every practical system frequency 
response is nonbandlimited, and the cycle overlap is inevitable. However, for fre- 
quencies beyond some o>o, if \H a (ju))\ is a negligible fraction, say 1%, of H a (ju>) | m ax> 
then we can consider 1 H a (jw) to be essentially bandlimited to u) 0 , and we can select 

T=— (12.46) 

tco 

I Example 12.4 

Design a digital filter to realize the first-order analog lowpass Butterworth filter with 
the transfer function 

lf 0 (s) — — ~~ o> c = 10 5 (12.47) 

S + Ul c 

tHow can we apply the discussion in Chapter 5, which applies to impulse samples of continuous- 
time signals, to discrete-time signals? Recall our discussion in Sec. 10.4 (Fig. 10.8), where we 
showed that the spectrum of discrete-time signal is just a scaled version of the spectrum ol the 
impulse samples of the corresponding continuous-time signal. 
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Fig. 12.11 An example of filter design by the impulse invariance method: (a) filter 
realization (b) amplitude response (c) phase response. 

Also, according to Eq. (12.47) (with u c — 10 5 ) 


Ha(ju>) 


U)c 


io 5 


jw + U c jw + 10 s 


(12.52) 


Therefore 


\H a (ju)\ = 


and lH a (ju) = - tan 


' naVWM ~ v/ ^ + lO TO ' 10“ 

Figures 12.11b and 12.11c show the amplitude and phase response of the analog and the 
(normalized)! digital filter over the frequency range 0 < ui < t t/T = 10 6 . Observe that 

fThe frequency response H[e> wT ] is higher than the desired frequency response because of 

aliasing. We can partially correct this difference by multiplying H[z) with a normalizing constant, 
forcing the resulting H[e^ r ] to be equal to at w = 0. The norm^ing conrtant A is 

defined as the ratio of H a {j0) to H[e’°] = H(l), which in ttecase is 1/1.653 - 0.858. The 
normalized amplitude response in Fig. 12.11b is that of 0.858 ( . _o.? 304 ) • 
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the behavior of the analog and the digital filter is very close over the range lu < u c = 10 5 . 
However, for higher frequencies, there is considerable aliasing, especially in the phase 
spectrum. H 

Q) Computer Example C12.3 

Using MATLAB, find the impulse invariance digital filter to realize the first-order 
analog Butterworth filter in Example 12.4. 

The analog filter transfer function is 10 5 /(s + 10 5 ) and the sampling interval T = 
10 6 it. A suitable MATLAB function to solve this problem is ' impinvar ’ . The input 
data are the coefficients of the numerator and the denominator polynomials of H a (s) 
[entered as (n + l)-element vectors num and den] and the sampling interval T. MATLAB 
returns b and a, the numerator and the denominator polynomial coefficients of the desired 
digital filter H[z\. 

In designing impulse invariance filter, we use the criterion h[k\ = Th a (kT ) in Eq. 
(12.39), whereas most books, including MATLAB, use the criterion h[fc] = h a (kT). Hence, 
out answer will be T times the answer returned by MATLAB. To correct this discrepancy, 
we multiply num by T. 

T=pi/1(T6; num=T*[0 10 5]; den=[l 10*5]; 

Fs=l/T; 

[b,a]=impinvar(num,den,Fs) 

MATLAB returns b=0.3142 and a=l -0.7304. Therefore 


»[*] = 


0.3142a 
z - 0.7304 


a conclusion which agrees with our result in Eq. (12.50). To plot the amplitude and the 
phase response, we can use the last 8 functions in Example 02.1. Q 
A Exercise E12.4 

Design a digital filter to realize an analog transfer function 


H a ($) = 


20 

s + 20 


Answer: H[z\ ~ ■ 


Limitations of the Impulse Invariance Method 

The impulse invariance method is handicapped by aliasing. Consequently this 
method can be used to design filters where H a (jui) becomes negligible beyond some 
frequency B Hz. This condition restricts the procedure to lowpass and bandpass 
filters. The impulse invariance method cannot be used for highpass or bandstop 
filters. Moreover, to reduce aliasing effects the sampling rate has to be very high, 
which makes its implementation costly. In general, the frequency-domain method 
discussed in the next section is superior to this method. 


12.6 Recursive Filter Design by the Frequency-Domain Criterion: 

The Bilinear Transformation Method 

The bilinear transformation method discussed in this section is preferable to 
the impulse invariance method in filtering problems where the gains are constant 
over certain bands (piecewise constant amplitude response). This condition exists in 
lowpass, bandpass, highpass, and bandstop filters. Moreover, this method requires 


12.6 Recursive Filter design: The Bilinear Transformation Method 


741 


a lower sampling rate compared to the impulse invariance method because of the 
absence of aliasing. In addition, the filter rolloff characteristics are sharper with 
this method compared to those obtained using the impulse invariance method. The 
absence of aliasing is the result of one-to-one mapping from s plane to z plane 
inherent in this method. 

The frequency-domain design criterion is [see Eq. (12.37)] 


lim H[e sT ] = H a (s) 
T — »0 


(12.53) 


Let us consider the following power series for the hyperbolic tangent (see Sec. B.7-3) 


e sT/2_ e -,T/2 _ r T \ / S T 
e sT/2 + e —sT/2 2 3 V 2 


_ + + . 
2 3 \ 2 + 15 \ 2 / 


(12.54) 


For small T (T -*■ 0), we can ignore the higher-order terms in the infinite series on 
the right-hand side to yield 

/ e sT/2 _ e -sT/2 \_sT 

T 1 ” ( e »T/2 + e - S T/2 J - 2 


Therefore, as T — > 0 


/ 2 \ e ‘ T /*- e -’ T ' 2 

S ~\ t ) e ‘ T / 2 + e ~ sT / 2 

/ 2 \ e sT - 1 
~ \T ) e sT + 1 


Equation (12.53) now can be expressed as 


From this result, it follows that 


,hat 


V ' S T z + 1 

Therefore, we can obtain H[z\ from H a (s) by using the transformationf 




(12.55a) 


(12.55b) 

(12.55c) 


(12.57) 


This transformation is known as the bilinear transformation. 


(There exist other transformations, which can be used to derive H[z] from H a {s). We start with 
the power series 

e~ sT = 1 - sT+ i(sT) 2 - |(sT) 3 + • ■ ■ 

In the limit as T -» 0, all but the first two terms on the right-hand side can be ignored. This 
yields 


This results in a transformation 
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Choice of T in Bilinear Transformation Method 

Because of the absence of aliasing in the bilinear transformation method, the 
value of the sampling interval T can be much smaller compared to the impulse 
invariance method. By absence of aliasing we mean only the kind of aliasing ob- 
served in impulse invariance method (Fig. 12.10b). The signal aliasing, which limits 
the highest usable frequency, is still present. Thus if the highest frequency to be 
processed is :F h Hz, then to avoid signal aliasing, we must use [see Eq. (8.17c)] 

T < r^- (12.58) 

Lfh 



a — i(l - -) = -=— (12.56a) 

T z Tz 

Similarly, starting with the power series for e sT yields the transformation 

s=i(2- 1) (12.56b) 

These are strikingly simple transformations, which work reasonably well for lowpass and bandpass 
filters with low resonant frequencies. They cannot be used for highpass and bandstop filters, 
however, and they are inferior to bilinear transformation. The transformation in Eq. (12.56b) also 
has a stability problem. 
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Fig. 12.12 Bilinear transformation method of design: (a) amplitude response (b) phase 
response. 


^ I T^T - cos ^72 85 

Figure 12.12 shows |H| and Zif as computed from Eqs. (12.59). Compare these with the 
filter characteristics obtained from the impulse invariant method (Fig. 12.11). ■ 


Q Computer Example C12.4 

Using MATLAB, find the bilinear transformed digital filter to realize the first-order 
analog Butterworth filter in Example 12.5. 

The analog filter transfer function is 10 5 /(« + 10 5 ) and the sampling interval T = 
10' 6 7r. Hence, the sampling frequency Fs= 10 6 /tt. A suitable MATLAB function to solve 
this problem is ‘bilinear’. The input data are the coefficients of the numerator and 
the denominator polynomials of ff.(s) [entered as (n + l)-element vectors num and den] 
and the sampling frequency Fs Hz. MATLAB returns b and a, the numerator and the 
denominator polynomial coefficients of the desired digital filter H[z}. 


Fs=10'6/pi; num= [0 10"5];dtm=[l 10"5]; 
[b,a]=bilinear(num,den,Fs) 


MATLAB returns b=0. 1358 0.1358 and a=l -0.7285. Therefore 


H[z} = 


0.1358(z + l) 
2 - 0.7285 


which agrees with the answer found in Example 12.5. To plot the amplitude and the phase 
response, we can use the last 8 functions in Example C12.1. 0 


Frequency Prewarping Inherent in Bilinear Transformation 

Figure 12.12 shows that \H[e jwT }\ * \H a {ju)\ for small u. For large values of w, 
the error increases. Moreover, \H [e-’ u ' r ]| = 0 atw = tt/T. In fact, it appears as if the 
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entire frequency band (0 to oo) in \H a (jbi)\ is compressed within the range (0, 
in H\e^ T }. Such warping of the frequency scale is peculiar to this transformation. 
To understand this behavior, consider Eq. (12.55a) with s = ju 


H[e*“ T ) = H a 


(2 e*“ T -l \ (2 

\Te* r + lj Ha \T e ^ +e ^J 


= H a (j% tan af) 


Therefore, response of the resulting digital filter at some frequency uid is 


t 

~t 


0 



H[e* u * T ] = H a (j | tan ^f) 

= H a (ju a ) (12.60) 

where 

2 ujT 

w« = - tan -y (12.61a) 

Thus, in the resulting digital filter, the behavior of the desired response H a (ju>) at 
some frequency u a appears not at u a but at frequency u >d, where [from Eq. (12.61a)] 

vd = tan -1 (12.61b) 

Figure 12.13a shows the plot of uj as a function of u> a . For small w a , the curve 
in Fig. 12.13a is practically linear, so bid — ui a . At higher values of ui a , there is 
considerable diversion in the values of ui a and uid- Thus, the digital filter imitates 
the desired analog filter at low frequencies, but at higher frequencies there is consid- 
erable distortion. Using this method, if we are trying to synthesize a filter to realize 
H a (jbi) depicted in Fig. 12.13b, the resulting digital filter frequency response will 
be, as illustrated in Fig. 12.13c. The analog filter behavior in the entire range of 
u a from 0 to oo is compressed in the digital filter in the range of uid from 0 to ir/T. 
This is as if a promising 20 year old man, who, after learning that he has only a 
year to live, tries to crowd his last year with every possible adventure, passion, and 
sensation that a normal human being would have experienced in an entire lifetime. 
This compression and frequency warping effect is the peculiarity of the bilinear 
transformation. 

There are two ways of overcoming frequency warping. The first is to reduce 
T (increase the sampling rate) so that the signal bandwidth is kept well below ^ 
and ui a ~ uid over the desired frequency band. This step is easy to execute, but 
it requires a higher sampling rate (lower T) than necessary. The second approach, 
known as prewarping, solves the problem without unduly reducing T. 

12.6-1 Bilinear Transformation Method with Prewarping 

In prewarping, we start not with the desired H a (jui) but with a prewarped 
H a (jw) in such a way that the warping because of bilinear transformation will 
compensate for the prewarping exactly. The idea here is to begin with a distorted 
analog filter (prewarping) so that the distortion caused by bilinear transformation 
will be canceled by the built-in (prewarping) distortion. The idea is similar to 



Fig. 12.13 Frequency warping in bilinear transformation: (a) mapping relationship of 
analog and digital frequencies (b) analog response (c) corresponding digital response. 

the one used in prestressed concrete, in which a concrete beam is precompressed 
initially. When loaded, the beam experiences tension, which is canceled by the 
built-in compression. 

Usually the prewarping is done at certain critical frequencies rather than over 
the entire band. The final filter behavior is exactly equal to the desired behavior 
at these selected frequencies. Such a filter is adequate for most filtering problems 
if we choose the critical frequencies properly. 

If we require a filter to have gains g\, g2, ■ ■ ., g m at frequencies (critical frequen- 
cies) ui 2 , ■ - •> respectively, then we must start with an analog filter H'(jui) 
which has gains g\, g2, ■ . ., g m at frequencies ui\ , ui2 , • • •, bi m ' respectively, where 
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Ui = ~ tan — i = l,2, (12.62) 

This results in prewarped filter Application of the bilinear transfor- 

mation (12.57) to this filter yields the desired digital filter which has gains g lt g 2: 
. . ., g m at frequencies wi, uj, . . ., respectively. This is because, according to Eq. 
(12.61a), the behavior of the analog filter at a frequency in,' appears in the digital 
filter at frequency 



We clarify these ideas with an example of a lowpass Butterworth filter. 

■ Example 12.6 

Design a lowpass filter with the following specifications: The gain of unity at u — 0, 
and the gain is to be no less than —2 dB (G p — 0.785) over the passband 0 < u> < 10. 
The gain is to be no greater than —11 dB ( G s = 0.2818) over the stopband ui > 15. The 
highest frequency to be processed is ujh = 35 rad/s, which yields T < 7t/35. Let us use 
T = it/35. 

The specifications for a Butterworth filter for this design are = 8, w, = 15, G p = 
—2 dB, and G a = -11 dB. In the first step, we prewarp the critical frequencies ui v and u, 
according to Eq. (12.62): 

<V = £tan ^ = 72 tan (|§) = 8.3623 

u,' = ytan = 72 tan (^f) = 17.7696 

In the second step, we design a Butterworth filter with critical frequencies u i p ' = 8.3623 
and LVs' = 17.7696 with G p = -2 dB and G s = -11 dB. The value of n (order of the filter) 
is obtained from Eq. (7.39): 


n 


log[(10 11 .r..l)Z.(lp.^--J)l = l, 9 405 
2 log(17. 7696/8. 3623) 


We round up the value of n to 2. There are two possible values of u/ c . We shall choose 
the one given by equation (7.41), which satisfies the stopband specifications exactly, but 
oversatisfies that in the passband. This choice yields the 3-dB cutoff frequency u; c as 


17.7696 
(10 11 - l)i 


= 9.6308 



Fig. 12.14 Amplitude response of the filter in Example 12.6. 


H\z\ = Ha{s) l, = (Z£>) 

92.7529 I 
~ s 2 + 13.62s + 92.7529 

0.1039(2 + l) 2 
“ z 2 - 0.9045 z + 0.3201 


The frequency response of this filter is given by 


H [e i “ T ] = 


0.1039(e^ T + l) 2 
e j 2 wT _ o.9045e:> , ‘' T + 0.3201 


The amplitude response with T — 70/7 r, is depicted in Fig. 12.14. B 


Summary of the Bilinear Transformation Method with Prewarping 

In the bilinear transformation method with prewarping, all the critical frequen- 
cies uq are transformed (prewarped) by the equation 


From Table 7.1, we find the prewarped filter transfer function H a (s) for n = 2 and tn c ' = 
9.6308 as 

fl«(s) = 


1 


92.7529 


( s i 2 | ,/n f s lii s 2 + 13.62s + 92.7529 

V 9.6308 / T v * V 9.6308 ) T 1 

Finally, we obtain H[z] from H a (s ), using the bilinear transformation 


/ 2\ z - 1 _ /70\ z - 1 
\T/ z + 1 V tt ) z + 1 


uj/ = — tan — t = l,2, (12.63a) 

T 2 

The prewarped cutoff frequency w c ', determined by using prewarped critical fre- 
quencies, is used to find the prewarped analog filter transfer function H a (s). Fi 
nally, we replace s with f in H a (s) to obtain the desired digital filter transfer 
function H[z] 


H[z] = H a (s) | s= 7^ 


This substitution yields 


(12.63b) 
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A Simplified Procedure 

The above procedure can be simplified by observing that the scaling factor 
is irrelevant in this manipulation and can be ignored. Instead of using Eqs. (12.63a) 
and (12.63b), we can use the simplified equations 


uji — tan 


i — 1,2 , -,m 


(12.64a) 


s = 1 _L (12.64b) 

2 + 1 

This simplification works because the factor 2/T in Eq. (12.63a) is a frequency 
scaling factor, and ignoring it in Eq. (12.64a) results in the pretransformed filter 
that is scaled by a factor 2/T in the frequency scale. This scaling is undone by 
using Eq. (12.64b) instead of Eq. (12.63b). 

To demonstrate the procedure, we shall redo Example 12.6 using this simplifi- 
cation. In the first step, we prewarp the critical frequencies u p and ui s according to 
Eq. (12.64a): 

w,/ = tan tan (g) = 0.3753 

W = tan SjE = tan (Jgf) = 0.7975 

In the second step, we design a Butterworth filter with critical frequencies 
ui p ' = 0.3753 and w s ' = 0.7975 with G p = -2 dB and G s = -11 dB. The value of 
n (order of the filter) is found from Eq. (7.39): 

_ logKio 1 - 1 - 1)/(10°- 2 - 1)] = , 9405 

” 2 log{0.7975/0.3753) 

We round up the value of n to 2. Also from Eq. (7.41), we find the 3-dB cutoff 
frequency w c ' as 

U '= ° 7 ^- = 0.4322 

(10 11 - l)i 

From Table 7.1, we find the prewarped filter transfer function H a {s ) for n = 2 and 
oi c ' = 0.4322 as 


Ha(») = 


/ , ^ . /tw s \ . i s 2 + 0.6112s +0.1868 

(0T322; + v/ V0.4322I 


Finally, we obtain H[z] from H a (s), using the simplified bilinear transformation in 
Eq. (12.64b): 


Therefore 

0.1868 _ 0.1039(2 + 1) 2 

H[z] = Ra(s)l s= £=i = 2 + 0 6112s +0.1868 „_.=i ~ z 2 + 0.9042 + 0.3201 

s ~ *+1 
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which is identical to the result obtained earlier. 

Q Computer Example C12.5 

Design a lowpass digital filter to meet the specifications in Example 12.6, using bilin- 
ear transformation with prewarping. 

We shall give here MATLAB functions to design the four types of approximations: 
Butterworth, Chebyshev, inverse Chebyshev, and elliptic. The input data asks for fre- 
quencies so normalized that the sampling radian frequency is 2. This requirement means 
the sampling radian frequency, which is 27r/T, must be normalized to 2. Therefore, all the 
radian frequencies can be normalized by multiplying each of them by T/n . In the present 
case, T = rr/35 so that T/i r = 1/35. Thus, to normalize any radian frequency, we just 
divide it by 35. The normalized Wp and Ws are 8/35 and 15/35, respectively. 

Wp=8/35;Ws=15/35;Gp=-2;Gs=-ll;T=pi/35; 

’/. Butterworth 

[n,W n]=buttord ( Wp,W s,-Gp,-Gs) ; 

[b,a] =butter(n,W n) 

% Chebyshev 

(n , Wn] =cheblord (Wp,Ws,-Gp,-Gs); 

[b,a]=chebyl(n,-Gp,Wn) 

*/, Inverse Chebyshev 

[n,Wn]=cheb2ord(Wp,Ws,-Gp,-Gs); 

[b,a] =cheby2(n,-Gs,W n) 

V, Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs); 

[b,a] =ellip(n,-Gp,-Gs,W n) 

l Plotting Amplitude and Phase Response 
W=0:.001:pi;W=W’; 

H=freqz(b,a,W); 

w=W/T; 

mag=abs(H); 

phase=180/pi*unwrap(angle(H)); 

subplot(2,l,l); 

plot(w,mag);grid; 

subplot(2,l,2); 

plot (w, phase) ;grid 

MATLAB returns b=0.1039 0.2078 0.1039 and a=l -0.9045 0.3201 for Butterworth 
option. Therefore 

0.1039(2 + l) 2 
2 2 - 0.90452 + 0.3201 

a result, which agrees with the answer found in Example 12.7. Q 


A Exercise E12.5 

Design a first-order lowpass Butterworth filter using the prewarping method so that the 
analog and digital gains are identical at u) = 0 and at the 3-dB cutoff frequency u> c . Use T = 7r/ 4 w c . 


Answer: 


0.8284(2 + 1) _ 0.2929 (z + 1) 

2.8284 2 - 1.1716 ~ 2 - 0.4142 
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Fig. 12.15 Chebyshev highpass filter design using bilinear transformation with prewarp- 
ing method. 


V 


I Example 12.7: Highpass Filter Design 

Design a 1-dB ripple Chebyshev highpass filter with the following specifications (de- 
picted by the brick walls in Fig. 12.15a): The stopband gain G s < -6.3 dB (G, < 0.484) 
over the stopband 0 < u < 10 (u s = 10). The ripple r < 1 dB (G p > 0.891) over a 
passband ui > 15 (u p = 15). The highest frequency to be processed is Uh = 80 radians/s. 

In order to select a suitable value of T, we use Eq. (12.58) to avoid signal aliasing: 

T < — = ==> Let us choose T = ~^— 

u h 80 100 

The critical frequencies tire -a = 10 and ui p — 15. The prewarped critical frequencies, 
according to Eq. (12.64a), are 

u,' = tan Sjp = tan(^g) = 0.1584 

Up' — tan ^ - = tan (|j ) = 0.24 

In the second step, we design a prewarped Chebyshev highpass filter with critical 
frequencies u,' = 0.1584 and u p = 0.24 with r = -1 dB and G, = -6.3 dB (Fig. 
12.15b). Following the procedure in Sec. 7.6-1, we first design a prototype lowpass filter 
with specifications, as indicated in Fig. 12.15b. Observe that the critical frequencies of 
the prototype filter are 1 (passband) and u p /u,' = 1.515 (stopband) as explained in Sec. 
7.6-1 

The value of n needed to satisfy these specifications is given by [see Eq. (7.49b)] 



(io 063 — il 1/2 
10 01 - 1 


1.988 


We round up the value of n to 2. From Table 7.4 (Chebyshev filter with r — 1 and n = 2) 
we obtain the following prototype transfer function 
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H p (s) 


0.982614 

s 2 + 1.0978s + 1.1025 


(12.65) 


Next, to obtain the desired highpass transfer function, we replace s with ui p '/s in the 
above prototype transfer function [see Eq. (7.55)]. To obtain the desired digital transfer 
function H\z], we then replace s with [the bilinear transformation in Eq. (12.64b)]. 
This two-step operation may be combined in a single-step transformation as 



( 12 . 66 ) 


In this case u p ' = 0.24 so that we replace s with ° i n the prototype transfer function 

in Eq. (12.65) to obtain the desired digital transfer function 


H[z\ = 


0.6902(z - l) 2 
z 2 - 1.4678z + 0.6298 


The continuous curve in Fig. 12.15a shows the amplitude response of this filter. 


Q Computer Example C12.6 

Design a highpass digital filter to meet the specifications in Example 12.7, using 
bilinear transformation with prewarping. 

As before, we shall give here MATLAB functions to design the four basic types of 
approximations. The input data asks for frequencies so normalized that the sampling 
radian frequency is 2. As explained in Example C12.5, all the radian frequencies can be 
normalized by multiplying each of them by T/ir. In the present case, T = 7r/100 so that 
T/tt = 1/100. Thus, to normalize any radian frequency, we just divide it by 100. The 
normalized Wp and Us are 15/100 and 10/100, respectively. 

Wp=0.15;Ws=0.1;-Gp=l;-Gs=6.3;T=pi/100; 

7. Butter-worth 

[n,Wn]=Buttord(Wp,Ws,-Gp,-Gs); 

[b,a]=butter(n,Wn,’high’); 

7, Chebyshev 

[n,Wn]=cheblord (Wp,Ws,-Gp,-Gs); 

[b,a] =chebyl(n,-Gp,Wn,’high’); 

% Inverse Chebyshev 

[n,W n]=cheb2ord(Wp,W s,-Gp,-Gs) ; 

[b,a]=cheby2(n,-Gs,Wn,’high’) 


7, Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs); 

[b,a]=ellip(n,-Gp,-Gs,Wn,’high’) 


MATLAB returns b=0 . 6902 -1.3804 0.6902 and a=l -1.4678 0 . 6298 for Chebyshev op- 
tion. Therefore 

0.6902(z - l) 2 
11 r 2 - 1.4678z + 0.6298 


which agrees with the answer found in Example 12.6. To plot the amplitude and the phase 
response, we can use the last 9 functions in Example Cl 2. 5. Q 
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Bandpass and Bandstop Filters 


For bandpass and bandstop filters, we follow a similar procedure. All the critical 
frequencies are first prewarped using the simplified form in Eq. (12.64a). Next, we 
determine a prototype lowpass filter, which is then converted to the desired analog 
filter using appropriate transformations discussed in Sec. 7.6. Finally, we use the 
bilinear transformation in Eq. (12.64b) to obtain the desired digital filter. As in 
the case of the highpass filter (discussed in Example 12.7), we can combine the two 
transformations into a single transformation. For the bandpass filter, we first use 
the transformation 


T(s) 


s 2 +u Pi 'ui P2 ' 

(w pa '-<j pi ')s 


and then use the bilinear transformation in Eq. (12.64b). Thus, in the first step 
we replace s in the prototype transfer function H p (s) with T(s) (the frequency 
transformation). In the second step we replace s with (the simplified bilinear 
transformation). Thus, the final transformation is equivalent to replacing s with 
Tb p [z] in the prototype filter transfer function H p (s), where 


Tipiz] — T(s)l s= i^ 


s 2 +u Pl 'ui P2 ' . ^ 

K >,' “ u pi') s S=fq ^ 


( 2 


- I) 2 +u Pl 'u Pi '{z + l) 2 

(«»'-‘V)(* 2 -i) 


(ujp/ iv P2 ' + 1 )z 2 + 2(lo Pi 'w P2 ' - l)z + (a>p/u’p 2 + 1) 
(up,' - u Pl ')( 22 - 1) 


Using the same argument, we can show that for the bandstop filter, the desired 
digital filter transfer function H [z] can be obtained from the corresponding bandstop 
prototype filter 'Hp(s) by replacing s with T bs [z ] , which is the reciprocal of Tf, p [z]. 
Both these transformations can be expressed in a more compact form as 


z 2 + 2 az + 1 
,pl2] = b(z 2 - 1) 

b(z 2 - 1) 

z 2 + 2 az + 1 


(12.67a) 

(12.67b) 


where 


W . T _1 and b = - p V 

UJ Pl' lJ P2 f ^ U Vl W P2 + * 


(12.68) 


Thus, a digital filter transfer function H[z) can be obtained from H p (s) by 
replacing s with T bp [z ] for the bandpass filter, and replacing s with r 6s [z] for the 
bandstop filter. 


12.6 Recursive Filter design: The Bilinear Transformation Method 
H Example 12.8 

Design a digital Butterworth bandpass filter with amplitude response specifications 
illustrated by the brick walls in Fig. 12.16a with w Pl = 1000, o> P2 = 2000, w 51 = 450, 
oi» 2 = 4000, G p = 0.7852 (—2.1 dB), and G, = 0.1(-20dB). Take T = x/10,000. 

The solution is executed in 3 steps: In the first step, we determine the prewarped 
critical frequencies. In the second step, the lowpass prototype filter transfer function H p (s) 
is found from the prewaxped critical frequencies. Finally, the desired H[z] is found from 
H p (s) using the lowpass analog to bandpass digital transformation by replacing s in H p {s) 
with Tbp[z], 

Step 1: Find prewarped critical frequencies 

The prewarped frequencies w P1 ', in M ', w n ', andu> S2 ' corresponding to the four critical 
frequencies oi pl , w P2 , cv 51 , and oj 32 using Eq. (12.64a): 



— tan 

w.jT 

2 



= tan 

/ 450tt \ 

= 0.0708 


\ 20, 000 ) 


= tan 

( lOOOir \ 
\ 20, 000 ) 

| = 0.1584 

U P2 

= tan 

/ 2000tt > 
\ 20, 000 j 

| = 0.3249 

Us 2 ' 

= tan 

( 4000X ' 

l 20,000 ) 

| = 0.7265 


Step 2: Find 7 i p (s), the prewarped lowpass prototype analog filter 

This procedure with 5 substeps is identical to step 1 in the design of an analog 
bandpass filter discussed in Example 7.10 (Sec. 7.6-2). The 5 substeps are. 

Step 2.1: Find u> s ' for the prototype filter. For the prototype lowpass filter 
transfer function H p {s) with amplitude response, as depicted in Fig. 12.16b. The 
frequency uj/ is found [using Eq. (7.56)] to be the smaller of 


(0.1584)(0.3249) - (0.0708) 2 _ 3 g3g 
0.0708(0.3249 - 0.1584) 


(0.7265) 2 - (0.1584) (0.3249) = 3 g37 
0.7265(0.3249 - 0.1584) 


which is 3.937. We now have a prototype lowpass filter in Fig. 12.16b with G p - 2.1 

dB, G, = -20 dB, w p ' = 1, and u,' = 3.937. 

Step 2.2: Determine the filter order n 

The order of the Butterworth filter from Eq. (7.39) is 


n = 


1 

2 log 3.937 


log 


io 2 - 1 
10° 2! _ 1 


1.8498 


which is rounded up to n = 2. 

Step 2.3: Determine the cutoff frequency ui c ' of the prototype filter 
In this step (which is not necessary for the Chebyshev design), we determine the 3-dB 
cutoff frequency u e ' for the prototype filter using any one of the Eqs. (7.40) or (7.41). 
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Fig. 12.16 Butterworth bandpass filter design using the bilinear transformation with 
prewarping. 

Each equation gives a different answer, in general. However either answer will satisfy 
the specifications. Let us select Eq. (7.41), which yields 


Step 2.4: Find the normalized filter transfer function 

The normalized second-order Butterworth filter transfer function (from Table 7.1) is 


«(*) = 


1 

s 2 + \[2 s + 1 


Step 2.5: Find the prototype filter transfer function H p (s) 

The prototype filter transfer function 74 p(s) is obtained by substituting s with sfu) c 
s/1.248 in the normalized transfer function H(s) found in step 4. This substitution 


W p (s) = 


s 2 + V2(1.248)s + (1.248) 2 


1.5575 

s 2 + 1.7649s + 1.5575 


Step 3: Find H[z] by using the bilinear transformation 

Finally, the desired transfer function H[z] of the bandpass filter is obtained from 
tipis) by replacing s with Tb p [z] from Eqs. (12.67) and (12.68). From Eq. (12.68), we 
obtain 


~ ^ __ —0-9485 
Ulp l , Ldp2 l + 1 1.0515 


-0.9021 and 


/ t 

— ^Pl 

UJ pi / w P2 / + 1 


0.1665 

1.0515 


0.1583 
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Substitution of these values in Eq. (12.67) yields 

, z 2 + 2az + 1 _ 6.317(z 2 - 1.8042z + l) 

TbrW - h{z z _ X ) z 2 - l 

The desired bandpass filter transfer function H[z) is obtained from H p (s) by substituting 
s with Tfcplz] : 

0.02964(z 2 - l) 2 

H |2] ~ z 4 - 3.1 19z 3 + 3.926z 2 - 2.354z + 0.576 
The amplitude response of this filter is illustrated in Fig. 12.16a. I 

Q Computer Example C12.7 

Design a bandpass digital filter to meet the specifications in Example 12.8, using 
bilinear transformation with prewarping. 

As before, we shall give here MATLAB functions to design the four basic types of 
approximations. In this case, Up and Us are 2-element vectors: Up=[1000 2000] and 
Us= [450 4000]. The input data asks for frequencies so normalized that the sampling 
radian frequency is 2. As explained in Example C12.5, all the radian frequencies can be 
normalized by multiplying each of them by T/it. In the present case, T = ir/10 4 so that 
T/tt = 1/10 4 . Thus, to normalize any radian frequency, we just divide it by 10 . The 
normalized Up and Us are [0.1 0.2] and [0 . 045 0.4], respectively. 

Wp=[0.1 0.2];Ws=[0.045 0.4];Gp=-2.1;Gs=-20; 

'/, Butterworth 

[n,Wn]=buttord(Wp,Ws,-Gp,-Gs); 

[b,a]=butter(n,Wn) 

% Chebyshev 

[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs) 

[b,a] =chebyl (n,-Gp, Wn) 

’/. Inverse Chebyshev 

[n,W n]=cheb2ord(Wp,W s,-Gp,-Gs) 

[b,a]=cheby2(n,-Gs,Wn) 

V, Elliptic 

[n , Wn] =ellipord ( W p,Ws,-Gp,-Gs) 

[b,a]=ellip(n,-Gp,-Gs,Wn) 

MATLAB gives b=0. 0296 0 -0.0593 0 0.0296 and a=l -3.119 3.9259 -2.3539 0.676 
for Butterworth option. Therefore 

0.0296(z 2 - l) 2 

~ z* - 3.119z 3 + 3.9259z 2 - 2.3539z + 0.5760 

a result, which agrees with the answer found in Example 12.8. To plot the amplitude and 
the phase response, we can use the last 9 functions in Example C12.5. (7) 

Q Computer Example C12.8 

Using bilinear transformation with prewarping, design a bandstop digital filter to 
meet the following specifications: Up=[450 4000] , Us=[1000 2000], G p - —2.1 dB , and 
G s = -20 dB. Use T = tt/10 4 . 
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As before, we give here MATLAB functions to design the four types of approxima- 
tions. The input data asks for frequencies so normalized that the sampling radian fre- 
quency is 2. As explained in Example C12.5, ail the radian frequencies can be normalized 
by multiplying each of them by T/n. In the present case, T = rr/10 4 so that T / -k — 1/10 4 . 
Thus, to normalize any radian frequency, we just divide it by 10 4 . 

Ws=[0.1 0.2];Wp=[0.045 0.4];Gp=-2.1;Gs=-20; 

7. Butterworth 

[n,Wn]=buttord(Wp,Ws,-Gp,-Gs) 

[b,a]=butter(n,Wn,’stop’) 

7. Chebyshev 

[n,Wn]=cheblord(Wp,Ws,-Gp,-Gs) 

[b,a]=chebyl(n,-Gp,Wn,’stop’) 

7. Inverse Chebyshev 

[n,Wn]=cheb2ord(Wp,Ws,-Gp,-Gs); 

[b,a]=cheby2(n,-Gs,Wn,’stop’) 

7. Elliptic 

[n,Wn]=ellipord(Wp,Ws,-Gp,-Gs); 

[b,a]=ellip(n,-Gp,-Gs,Wn,’stop’) 

MATLAB returns b=0 . 3762 -1.3675 1.9711 -1.3575 0.3762 and a=l -2.2523 2.0563 
-1.2053 0.4197 for Chebyshev option. Therefore 


Hz] = 


b n z n + i> n -l z n_1 + • ' ' + biz + bo 


, , fen-l , frn-2 bi bp 

bn + 2 7 n—\ ^ z n 


(12.69a) 

(12.69b) 


Now, by definition, H[z] is the z-transform of h[k]: 

OO 

h W = 2>] 2 -* 

fc =0 

= M 0] + ^l + MS + ... + ^l + fc^ + --- (12.70) 

Comparison of this equation with Eq. (12.69b) shows that h[k] — 0 for k > n, and 
Eq. (12.70) becomes 


H[z} = h[0] + ^ + 7T 




MM 


/i[0]z n + fc[l]z Tt ~ 1 + h h[n - l]z + MM 

z n 


(12.71a) 

(12.71b) 


_ 0.3762(z 4 - 3.6084z 3 + 5.2395z 2 - 3.6084s + 1) 

~ z 4_ 2.2523z 3 + 2.0563z 2 - 1.2053s + 0.4197 

To plot the amplitude and the phase response, we can use the last 9 functions in Example 
C12.5. O 

12.7 Nonrecursive Filters 

The recursive filters are very sensitive to coefficient accuracy. Inaccuracies in 
their implementation, especially too short a word length, may change their behavior 
drastically and even make them unstable. Moreover, the recursive filter designs are 
well established only for amplitude responses that are piecewise constant, such as 
lowpass, bandpass, highpass, and bandstop filters. In contrast, a nonrecursive filter 
can be designed to have an arbitrarily shaped frequency response. In addition, 
nonrecursive filters can be designed to have a linear phase response. On the other 
hand, if a recursive filter can be found to do the job of a nonrecursive filter, the 
recursive filter is of lower order; that is, it is faster (with less processing delay) and 
requires less memory. If processing delay is not critical, the nonrecursive filter is the 
obvious choice. They also have an important place in non-audio applications, where 
a linear phase response is important. We shall review the concept of nonrecursive 
systems briefly. 

As discussed in Sec. 12.3, nonrecursive filters may be viewed as recursive filters, 
where all the feedback or recursive coefficients are zero; that is , when 

ao = ai = «2 = ' ' ' — a n-l = 0 

Consequently, the transfer function of the resulting nth-order nonrecursive filter is 


where 



0 < k < n 
k > n 


(12.72) 


The impulse response MM has a h n 'fe width of (n + 1) elements. Hence, these 
filters are finite impulse response (FIR) filters. We shall use the terms nonrecursive 
and FIR interchangeably. Similarly, the terms recursive and HR (infinite impulse 
response) will be used interchangeably in our future discussion. 

The impulse response MM can he expressed as 


MM = Mo]Mfc] + MM 5 !* - 1] + • • • + MMM fc - M ( 12J3 ) 

The frequency response of this filter is obtained from Eq. (12.71a) as 


H [e^ T ] = M0] + Ml]e-^ T + ' ' ' + h[n]e-^ T (12.74a) 

= Y j h [k\e~ ikulT (12.74b) 

fc= o 

Filter Realization 

The nonrecursive (FIR) filter in Eq. (12.69a) is a special case of a general 
filter with all feedback (or recursive) coefficients zero. Therefore, the realization of 
this filter is the same as that of the nth-order recursive filter with all the feedback 
connections omitted. Figure 12.7b shows a canonical realization of this filter. It is 
easy to verify from this figure that for the input 6[fc], the output is MM 6* v ^ n 
(12.73). 
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The filter in Fig. 12.7b is a tapped delay line with successive taps at unit delay 
(T seconds). Such a filter is known as a transversal filter. Tapped analog delays 
are integrated circuits, which are available commercially. In these circuits the time 
delay Is implemented by using charge transfer devices, which sample the input signal 
every T seconds (unit delay) and transfer the successive values of the samples to m 
storage cells. The stored signal at the fcth tap is the input signal delayed by k time 
units (kT seconds). The sampling interval can be varied electronically over a wide 
range. Time delay can also be obtained by using shift registers. 

12.7-1 Symmetry Conditions for Linear Phase Response 

Consider an nth-order finite impulse response (FIR) filter described by the 
transfer function H[z\ [ Eq. (12.69) or (12.71)] and the corresponding impulse re- 
sponse h[k\ [Eq. (12.73)]. We now show that if h[k] is either symmetric (Fig. 12.17a) 
or antisymmetric (Fig. 12.17b) about its center point, the filter phase response is 
a linear function of to. We consider a case where n is even. To avoid too much 
abstractness, we choose some convenient value for n, say n = 4, to demonstrate our 
point. It will then be easier to understand the generalization to the nth-order case. 

For n = 4, the impulse response in Eq. (12.73) reduces to 

h[k] = h[Q]S[k] + h[l}S[k - 1] + h[2]S[k - 2] + h[3]S[k - 3] + /i[4]<5[fc - 4] 

The transfer function H[z] in Eq. (12.71b) reduces to 


= z~ 2 (h[0]z 2 + h[\]z + h[2\ + h]3]z _1 + h\A]z~ 


(12.75a) 

(12.75b) 


Therefore, the frequency response is 


H[e j “ T ] = e“ j2wT [h[ 0]M 2wT + h[l]e j “ T + h[ 2] + h{S[e~ 3 “ T + h[4]e^ 2 “ T J (12.76) 

If h[k] is symmetric about its center point (k = 2 in this case), then 
h[0] = fc[4], h[l] = h[ 3] 
and the frequency response reduces to 

B[e^ T } = e- j2a,r ^[0] [e i2u,T + e* j2 “ T ] + h[ 2] + h[l] [e>“ T + 

= e~ i2ujT (h\2] + 2h[\] cos toT + 2/i[0] cos 2 toTj 


(12.77) 
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Fig. 12.17 Symmetry conditions for linear phase frequency response in nonrecursive 
filters. 

The quantity inside the parenthesis is real; it may be positive over some bands of 
frequencies and negative over other bands. This quantity represents the amplitude 
response [e J ‘*' r ] | -t The phase response is given by 

IH [M wT ] = -2 toT 

The phase response is a linear function of to. The time delay is the negative of 
the slope of LH[e iuT ) with respect to w, which is 2T seconds in this case [see Eq. 

(4-59)]. , . , . 

If h[k] is antisymmetric about its center point, then the antisymmetry about 
the center point requires that h[k] = 0 at the center point]; [see Fig. 12.17b]. Thus, 
in this case 


Mo] = -M4], Mi] = -M 3 )- M2] = o 

and the frequency response reduces to 


H[e^ T ] = e-WM0](e^ T - ^ T ) + h[l]{e^ T - e^ T )) 
= 2je _ - ,2u ' T ^h[l] sin uT + h[0] sin 2i oT^j 
— 2e^^~ 2wT ' > ^h[l] sin uiT + ft- [0] sin 2u jTj 


Thus, the phase response in this case is 


LH[e^ T ) = ^-2wT 


fStrictlv speaking, \H[e^ T ]\ cannot be negative. Recall, however, that the only restriction on 
amplitude is that it cannot be complex. It has to be real; it can be positive or negative. e 
should have used some other notation such as A{ w) to denote the amplitude response. But this 
would create too many related functions causing possible confusion. Another altematiye is to 
incorporate the negative sign of the amplitude in the phase response, which *>1 be mcre^d (or 
decreased) by jr over the band where the amplitude response is negative. This alternative will still 
maintain the phase linearity. 

] Antisymmetry property requires that h[k] = -h[-k] at the center point also. This condition is 
possible only if h[k] = 0 at this point. 
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Using the same argument, the reader can show that an nth-order comb filter transfer 


1< 

' h[k] 

(a) 

6 

2 7 

1/7 ji 

\A <c> 

function is 

»w-V 

(12.79) 
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and 

HW°\ = 2e>(*-^) sin ^ M 



(b) 

. ah [<r'“l 

<d) 






Fig. 12.18 Comb filter: Its impulse and frequency response. 


The phase response in this case is also a linear function of ui. The system has the 
time delay (the negative slope of Z H [e lulT ] with respect to u) of 2 T seconds (2 
units), the same as in the symmetric case. The only difference is that the phase 
response has a constant term rr/2. 

We can obtain similar results for odd values of n (see Prob. 12.7-1). This result 
can be generalized for an nth-order case to show that the phase response is linear, 
and the time delay is seconds (or ^ units). 

■ Example 12.9: Comb Filter 

Determine the transfer function and the frequency response of a sixth-order comb 
filter whose impulse response is given by 

h{k] = 6[Ar] - 6{k - 6] 

This impulse response is illustrated in Fig. 12.18a. Its canonical realization is depicted in 
Fig. 12.18b. Observe that h[fc] is antisymmetric about fc = 3. Also 

°° r 6 - 1 

ffM = £/[k]*- fc = l-z- 6 = ^r- (12.78) 


12.8 Nonrecursive Filter Design 

As in the case of recursive (IIR) filters, nonrecursive filters can be designed by 
using the time-domain and the frequency-domain equivalence criteria. In the time- 
domain equivalence criterion, the digital filter impulse response is made identical to 
the samples of the desired (analog) filter impulse response. In the frequency-domain 
equivalence criterion, the digital filter frequency response samples at uniform fre- 
quency intervals are matched to the desired analog filter frequency response samples. 
This method is also known as the frequency sampling or the spectral sampling 
method. 

12.8-1 Time-Domain Equivalence Method of FIR Filter Design 

The time-domain equivalence method (also known as the Fourier series 
method) of design of FIR filters is identical to that for IIR filters discussed in Sec. 
12.5, except that FIR filter impulse response must be of finite duration. Therefore, 
the desired impulse response must be truncated to have finite duration. Truncating 
the impulse response abruptly will result in oscillatory frequency response because 
of the Gibbs phenomenon discussed in Sec. 3.4-3. In some filtering applications 
the oscillatory frequency response (which decays slowly as l/o>) in the stopband 
may not be acceptable. By using a tapered window function for truncation of h[fc], 
the oscillatory behavior can be reduced or even eliminated at the cost of increasing 
the transition band as discussed in Sec. 4.9. Note that the impulse response of 
an nth-order FIR filter has n + 1 samples. Hence, for truncating h[k] for an n-th 
order filter, we must use an IV 0 -point window, where JV 0 = n + 1. Several window 
functions and their tradeoffs appear in Table 12.2. 


The frequency response is given by 

H[e jn ] = 1 - e~ l6n 

= - e~ i3a ) 

= 2 sin 3D 
= 2 e ’(5- 3n )sin 30 

The term sin 30 can be positive as well as negative. Therefore 

|ff[e-’ n ]| = 2|sin 30 1 

and Zff(e jn ] is as indicated in Fig. 12.8d. The amplitude response, illustrated in Fig. 
12. 18c, is shaped like a comb with periodic nulls. The filter can be realized by the structure 
in Fig. 12.7b. Since h[fc] = bs-k [see Eq. (12.72)], bo = -1, bi = b? = 63 = 64 = bs = 0, 


Design Procedure 

Much of the discussion so far has been rather general. We shall now give some 
concrete examples of such filter design. Because we want the reader to be focussed 
on the procedure, we shall intentionally choose a small value for n (the filter order) 
to avoid getting distracted by a jungle of data. The procedure, however, is general 
and it can be applied to any value of n. 

The steps in the time-domain equivalence design method are: 

1. Determine the filter impulse response h[k] 

In the first step, we find the impulse response h[k] of the desired filter. Ac- 
cording to the time-domain equivalence criterion in Eq. (12.31), 

h[k\ = Th a {kT) 


(12.80) 
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TABLE 12.2 

Some Window Function and Their Characteristics 


Window w[fc] 


Rolloff Peak 

Mainlobe Rate Sidelobe 

Width dB/octave Level in dB 


~M < k < M 

1 Rectangular: rect ( ^ fc _ t ) 

2 Bartlett: A ( 

3 Hanning: 0.5 [l 4- cos ( Mq-i )] 

4 Hamming: 0.54 4- 0.46 cos ( ) 

5 Blackman: 0.42 4- 0.5 cos +0.08( 1 ^ T ) 


6 Kaiser: 




T575T 


1 < a < 10 


4ir 

No 

-6 

-13.3 

87T 

No 

-12 

-26.5 

8tt 

N 0 

-18 

-31.5 

8tt 

N 0 

-6 

-42.7 

12w 

N 0 

-18 

-58.1 


—6 -59.9 (a = 8. 168) 


where h a (t) is the impulse response of the analog filter H a (s). Therefore, h a (t) 
is the inverse Laplace transform of H a (s) or the inverse Fourier transform of 
H a (ju). Thus, 

h a {t) = T" / 7 H^juy^du, (12.81a) 

^ J—n/T 

Recall that a digital filter frequency response is periodic with the first period in 
the frequency range — ^ < w < f. Hence, the best we could hope is to realize 
the equivalence of H a (ju>) within this range. For this reason, the limits of 
integration are taken from -n/T to tt/T. Therefore, according to Eq. (12.80) 

h[k] = Th a (kT) = f - [ ^ H a (ju,y ukT du (12.81b) 

J-n/T 


2. Windowing 

For linear phase filters, we generally start with zero phase filters for which 
H a (ju>) is either real or imaginary. The impulse response h a (t) is either an even 
or odd function of t (see Prob. 4.1-1). In either case, h a (t) is centered at t = 0 
and has infinite duration in general. But h[fc] must have only a finite duration 
and it must start at fc = 0 (causal) for filter realizability. Consequently, the 
found in step 1 needs to be truncated using an iVo-point window and then 
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delayed by to make it causal. This delay produces the desired linear-phase 
frequency response. 

Straight truncation of data amounts to using a rectangular window, which has 
a unit weight over the window width, and zero weight for all other k. We saw 
that although such a window gives the smallest transition band, it results in a 
slowly decaying oscillatory frequency response in the stopband. This behavior 
can be corrected by using a tapered window of a suitable width. 

* 

3. Filter Frequency Response and Realization 

Knowing h[0], h[l], h[2], ■ • • , fc[n], we determine H [z] using Eq. (12.71) and the 
frequency response H [e* 7 ^] using Eq. (12.74). We now realize the truncated 
h[ifc] using the structure in Fig. 12.7b. 


Optimality of the Procedure 

The procedure outlined here using a rectangular window function is the op- 
timum in the sense that the energy of the error (difference) between the desired 
frequency response H a (ju>) and the realized frequency response 1/ ! r/ is the min- 
imum for a given Nq. This conclusion follows from the fact that the resulting filter 
frequency response H [e- ,u,T ] is given by 

K[e^ T ] = ^/ l [fc]e-^ fcT 
k 

This frequency response is an approximation of the desired frequency response 
Hjju) because of the truncation of h[k]. Thus, 

« Yl h W e ~ iUkT 

k 

How do we select h[fc] for the best approximation in the sense of minimizing the 
energy of the error H a (ju) — H We have already solved this problem in 

Sec. 3.3-2. The above equation shows that the right-hand side is the finite term 
exponential Fourier series for H a (ju>) with period 2ir/T . As seen from Eq. (12.81b), 
ft[k] are the Fourier coefficients. We also know that a finite Fourier series is the 
optimum (in the sense of minimizing the error energy) for a given N 0 according to 
the finality property of the Fourier coefficients discussed in Sec. 3.3-2. f Clearly, this 
choice of h[k] is optimum in the sense of the minimum mean squared error. For the 
obvious reason, this method is also known as the Fourier series method. 


■ Example 12.10 

Design an ideal lowpass filter for audio band with cutoff frequency 20 kHz. Use 
a sixth-order nonrecursive filter using rectangular and Hamming windows. The highest 
frequency to be processed is J-h — 40 kHz. 

In this case n = 6 and No = n + 1 = 7. First we shall choose a suitable value for T . 
According to Eq. (12.58) ^ 


T 



1 

2.F h 


= 12.5 x 10" 6 


(Note that this finite term Fourier series corresponds to the rectangular window function. For 
windows other than rectangular, the optimality does not hold. 
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Recall that a continuous-time sinusoid of frequency to, during digital processing appears 
as a discrete-time sinusoid of frequency ft = u jT. The cutoff frequency to c — 2ir(20, 000) = 
40, 000 7r appears as a discrete- time sinusoid of frequency 

fi c = w c T = 40, 000jr(12.5 x 10“ 6 ) = and u c = ^ 

The desired (zero phase) filter frequency response is depicted in Fig. 12.19a on both to and 
ft scales. Recall that the digital frequency range is from — ir to it only. We wish to design 
an ideal lowpass filter of cutoff frequency to c = rad/s. The frequency response has a 
period of 27r on ft scale, and 2 n/T on to scale. Rather than substitute T = 12.5 x 10 -6 , 
it is convenient to leave T as an unknown in our computations and substitute the value 
only in the end. Thus, we shall use the radian cutoff frequency u c = tt/2 T. 

The impulse response of the desired ideal lowpass (zero phase) filter in Fig. 12.19a is 
(Table 4.1, Pair 18) 

M0 = ^ sine (^) (12.82) 

and according to the impulse invariance criterion [Eq. (12.39)] 

M*1 = Th a (kT) = i sine (^r) = \ sine ( ^) (12.83) 

Figure 12.19b shows h[fc]. To make this filter realizable, we need to truncate it using a 
suitable N 0 - point window, then delay the truncated /i[fc] by N; ~ 1 units. In the present 
example, No = 7. Figure 12.19c shows the impulse response truncated by a 7-point 
rectangular window and Fig. 12.19d shows the truncated h[k] delayed by 1 = 3 units. 

Note that the noncausal filter in this case is made realizable at the cost of a delay of 
t = 3T seconds. This constant delay of rJ bf is what produces a linear phase characteristic. 
The rectangular windowed, causal filter impulse response hrt[fc] is the truncated h[k\ in 
Fig. 12.19d delayed by 3T. 

= h[k - 3] = ^sinc ^ ^ 0 < k < 6 (12.84) 

The values of the coefficient An[k] are shown in Table 12.3. Also 



6 

H R [e^ T ] = Y J ^R[k]e- iwkT 
k - 0 



(12.85) 


(12.86) 


12.8 Nonrecursive Filter Design 


765 




(c) 




The term e "^ 3a,r i s a linear phase representing the delay of 3 T seconds. The mag- 
nitude of the bracketed term, depicted in Fig. 12.19a by a solid curve, exhibits oscilla- 
tory behavior which decays rather slowly over the stopband. Although increasing n (the 
system order) improves the frequency response, its oscillatory nature persists (Gibbs phe- 
nomenon). f In some filtering applications, the oscillatory characteristic (which decays 
slowly as 1 /to) in the stopband may not be acceptable. By using a tapered window func- 

fEq. (12.86) is identical to the first three terms in Eq. (3.61) except that the former is a function 
of to and the latter is a function of t. Clearly, H[e^ u,T ] is a truncated Fourier series for the gate 
function. As we increase n, H[e^ wT ] converges to the gate function in the manner depicted in Fig. 
3.11. Regardless of the value of n, however, H[e^ ujT ] exhibits oscillatory behavior because of the 
Gibbs phenomenon. 
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TABLE 12.3 


Rectangular Window 

Hamming Window 

k 


tu R [fc] 


0 

— 1/3t r 

0.08 

-0.00848 

1 

0 

0.31 

0 

2 

1 / 7T 

0.77 

0.245 

3 

1/2 

1 

0.5 

4 

1 / 7T 

0.77 

0.245 

5 

0 

0.31 

0 

6 

— 1/3tt 

0.08 

-0.00848 


tion such as a Hamming window, the oscillatory behavior can be eliminated at the cost 
of increasing the transition band (from passband to stopband). The Hamming window 
function is given by 


tu/r[fe] = 


( 0.54 + 0.46 cos 

\o 


( 


N 0 -U 


<IM< 


otherwise 


(12.87) 


In our case No — n + 1 = 7. Hence, 


w H {k] = 


( 0.54 + 0.46 cos 

lo 


(t) 


-3 < |fc| < 3 
otherwise 


Table 12.3 also shows the (delayed) Hamming window coefficients and the corre- 

sponding impulse response hu[k] = h[k]wH[k}. The frequency response of the Hamming 
window filter is 


H H [e i “ T ] = e~ i3wT [| + 0.245 (e >T + e~ iuT ) - 0.00848 ( e j3wT + e j3 " T )] 

= e~ i3 “ T [i + 0.49 cos wT - 0.01696 cos 3 uT] 

With the coefficients h R [k] (or hn[fe]) in Table 12.3, the desired filter can be realized by 
using six delay elements, as depicted in Fig. 12.7. 

According to Eqs. (12.86), we have 


and 


|ff R [e JU,T l| = |I + \ cos uT - £ cos 3u/T| (12.88a) 


-3 uT 


when 


| \ cos ujT — cos 3u;T > 0 
^ + f cos cjT — cos 3u/T < 0 


For the Hamming filter 

\Hh [e' 7 ‘ 43 '] I = | + 0.49 cos wT - 0.01696 cos 3u >T LH H [e , “ T } = -3wT (12.88c) 

In either filter, the phase response is a linear function of ui with slope -3T, indurating 
time delay of 3T. Note that both h R [k] and h h [k] are symmetric about k = 3. ■ 

Q Computer Example C12.9 

Using MATLAB, find the frequency response of the lowpass filter in Example 12.10 
for 98th-order filter. Plot the frequency response for rectangular and Hamming window 
filters. 

N0=99; 

m=(NO-l)/2; 

k=0:N0-l; 

hl=(l/ 2 )*sinc((k-m)/ 2 ); 

numl=hl; 

denl=[l, zeros(l,N0-l)]; 

W=-pi:pi/100:pi; 

Hl=freqz(numl,denl,W); 

magl=abs(Hl); 

phasel=180/pi*unwrap(angle(Hl)); 

for i=l:N0 

k=i-l; 

h 2 (i)=(l/ 2 )*sinc((k-m)/ 2 )*( 0 . 54 + 0 . 46 *cos(pi*(k-m)/m))s 

end 

num2=h2; 

den2 — [1, zeros(l,N0-l)]; 

W=-pi:pi/100:pi; 

H2=freqz(num2,den2,W); 

mag2=abs(H2); 

phase 2 = 180 /pi*unwrap(angle(H 2 )); 

subplot(2,l,l); 

plot ( W ,magl ,W ,mag2) ;grid; 

subplot( 2 ,l, 2 ); 

plot(W,phasel,W,phase2);grid Q 


If we were to use n = 8 filter in Example 12.12, show that the filter transfer function for the 
bartlett (triangular) window is 

— n.02653z 6 + 0.2387s 4 + 0.5z 3 + 0.2387z 2 + 0.02653 

HM 15 

Observe that in this case the filter order is reduced by 2 because the two end-points have a zero 
value for the Bartlett window. V 


I Example 12.11 

Design a differentiator using a tenth-order nonrecursive filter. 

In this case n = 10 and N 0 = 11. The transfer function of an ideal differentiator is 
H a (s) - s. Therefore, 


lHn[e^ T } = 


7T — 3 U)T 


when 


(12.88b) 


Ha(jv) = jU 
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and according to Eq. (12.81b)f 



r*/T 

/ 

J-ir/T 


dw 


cos kir 
kT 


(12.89) 


This is a noncausal filter. We truncate it using an 11-point window and then delay it by 
—° 2 — = 5 units to make it realizable. The desired impulse response using a rectangular 
window is 


h R [k] = h[k — 5] 0 < k < 10 

Table 12.4 shows this impulse response under the rectangular window. The frequency 
response is 

10 

k—0 


Therefore, the phase characteristic of H R [e jwT ] is identical to the desired (ideal) differen- 
tiator with a delay of 5 T seconds. Figure 12.20 shows the amplitude response \H\ of the 
realized filter and the \H a \ of the ideal (desired) differentiator. The amplitude response 
|// , fl[e J '“' T ]|, which is oscillatory, can be improved by using a tapered window function to 
truncate h a (t) gradually. The Hamming window function ujn[k] [Eq. (12.87)] for n = 10 
is given by 

f 0.54 + 0.46 cos (f) |fc| < 5 

WH[k\ — < 

1 0 otherwise 

Table 12.4 shows the (delayed) Hamming coefficients w R [k ] and the corresponding filter 
impulse response = h[k]wH[k]. Note that and hn[k] are both antisymmetric 
about k = 5. Using the Hamming coefficients from Table 12.4, Jfjf [e , ’ wT ], the windowed 
filter frequency response, is given by 

HhW“ iT ] = i e ;,( T“ 5 "’ r) [1.8242 sin uiT - 0.682 sin 2uiT + 0.2652 sin 3 wT 
-0.0839 sin 4 wT + 0.032 sin 5 uT\ 


Substitution of values of from Table 12.4 in this equation yields 

= ±e~ j *“ T [(e J '" T - e~ JU,T ) - i(e i2wT - e - i2uT ) + i(e’ 3uT - e~ i3 “ T ) 
- i(e-’ 4wT - e~ j4 “ T ) + i(e J ' 5wT - e- j5uT )] 

= j5 “ T [2 sin wT — sin 2 uT + | sin 3uiT — | sin 4uiT + | sin 5u/rj 
= y e j( * ~ 5 " T) [2 sin wT - sin 2 wT + § sin 3 ojT - ± sin 4u :T + § sin 5wT] 

Hence 


|H'R[e J “ T ]| = ^ 1 2 sin wT - sin 2 uT + § sin 3 wT - \ sin 4 uT + § sin 5<vT| (12.90a) 


and 

- 5u )T u) > 0 

2 + w < 0 

The terms ±5u/T represent the time delay of 5 T seconds. Note that because H a (jv) = ju > , 


Ztf*[e^ J ) = 


{!: 

2 


(12.90b) 


\Ha(jul)\ = |o»| 

£H a (ju) = 


7 r /2 U) > 0 

— 7r/2 to < 0 


(12.91) 


fNote that according to Eq. (12.81a) 


72 T 


jut dw — 0 


tt/ 2 T 


Figure 12.20 shows the amplitude response of the ideal, the rectangular-windowed, 
and the Hamming-windowed filter characteristics. The phase response of both the realized 
filters are identical, but with a delay of 5 T seconds. The amplitude response of the 
windowed (Hamming) filter is practically the same over a large band (two thirds of the 
band) as that for the ideal filter, and hence is preferable to the unwindowed (or rectangular- 
windowed) filter. 


TABLE 12.4 


Rectangular Window 


Hamming Window 

k 

hrt[k] 



0 

1/5T 

0.08 

0.016/T 

1 

-1/4 T 

0.1678 

— 0.04195/T 

2 

1/3 T 

0.3978 

0.1326/T 

3 

-1/2T 

0.6821 

— 0.3410/T 

4 

1/T 

0.9121 

0.9121/T 

5 

0 

1 

0 

6 

—1/T 

0.9121 

-0.9121/T 

7 

1/2 T 

0.6821 

0.3410/T 

8 

-1/3 T 

0.3978 

-0.1326/T 

9 

1/4 T 

0.1678 

0.04195/T 

10 

— 1/5 T 

0.08 

-0.016/T 


Therefore, /i[0] = 0. 


770 


771 


12 Frequency Response and Digital Filters 



Fig. 12.20 An ideal differentiator design by a tenth-order nonrecursive filter using 
rectangular and Hamming windows. 

The amplitude response of the Hamming filter is practically ideal up to frequency 
w fa (2/3 )(ir/T) = 27r/3T. If we wish to design a digital differentiator for audio application, 
for instance, where the highest frequency is, say 20 kHz, we should select this frequency 
to be less than 2rr/3T. Thus, 

2tt x 20, 000 < ==> T < 16.67 ps 

“3 T 

Thus, a choice of T < 16.67 fis would result in a desired differentiator. This example (also 
Fig. 12.20) shows that a Hamming window shrinks the passband. This is generally true of 
tapered windows. To compensate for this shrinkage, we start with a passband somewhat 
larger (typically 25% larger) than the design passband. In the present case, for instance, 
selecting T = 16.67 fis would make the passband — n/T & 2^(30,000), which is 50% 
higher than the design passband of 20,000 Hz. I 

O Computer Example C12.10 

Using MATLAB, find the frequency response of the 48th-order digital differentiator 
in Example 12.10. Plot the frequency response for rectangular and Hamming window 
differentiators. 

N0=49; 

m=(N0-l)/2; 

k=0:N0-l; 

T=l; 

hl=cos((k-m)*pi)./((k-m)*T);hl(25)=0; 

numl=hl; 

denl=[l, zeros(l,N0-l)]; 

W=-pi:pi/100:pi; 

Hl=freqz(numl,denl,W); 

magl=abs(Hl); 

phasel = 180/pi*unwrap(angle(Hl)); 

h2=cos((k-m)*pi)./((k-m)*T).*(0.54-j-0.46*cos(pi*(k-m)./m));h2(25)=0; 
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num2=h2; 

den2=denX; 

H2=freqz(num2,den2,W); 

mag2=abs(H2); 

phase2— 180/pi*unwrap(angle(H2)); 

subplot(2,l,l); 

plot (W, magi, W,mag2); 

subplot(2,l,2); 

plot(W,phase2,W,phasel); Q 


A Exercise E12.7 

Design a sixth-order nonrecursive filter to realize H a (ju) = A(u/T/7r) 
Answer: 



|Jfc| <3 
|fc| > 3 V 


12.8-2 Nonrecursive Filter Design by the Frequency-Domain Criterion: 
The Frequency Sampling Method 


The frequency-domain criterion is [see Eq. (12.36)] 

H a ( S ) = R[e sT ] 

In this case we shall realize this equality for real frequencies; that is, for s = jur. 


H a (ju) = H[e iuT ] 


(12.92) 


For an nth-order filter, there are only Nq — n + 1 elements in h[k], and we can hope 
to force the two frequency spectra in Eq. (12.92) to be equal only at No points. 
Because the spectral width is we choose these frequencies wo = rad/s 
apart; that is , 


wq : 


2ir 


(12.93) 


We require that 


Hjjruo) = H[e jr “° T ] r = 0, 1, 2, , • • • , N 0 - 1 (12.94) 

Note that these are the samples of the periodic extension of H a (j'w) (or 7f[e J " T ]). 
Because we force the frequency response of the filter to be equal to the desired 
frequency response at No equidistant frequencies in the spectrum, this method is 
known as the frequency sampling or the spectral sampling method. 

In order to find the filter transfer function, we first determine the filter impulse 
response h[k}. Thus, our problem is to determine the filter impulse response from 
the knowledge of the No uniform samples of the periodic extension of the filter 
frequency response H{e^ uT ], But H [e JU,T ] is the DTFT of h{k] [see Eq. (10.92)]. 
Hence, as shown in Sec. 10.6-2 [Eqs. (10.68) and (10.69)], h[fc] and H [e-’ ru '°- r ] (the 
No uniform samples of H [e-’ u,T ] ) are the DFT pair with f2o = ojqT. Hence, the 
desired h[k] is the IDFT of H{ei ujT \, given by 
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, JVo-l 

ftljfel = — V H\e irwoT }e irkwoT 
N ° 

i jv ° -1 

= — ]T) H [e ir " oT ]e : ' 2ft » iL fc = 0, 1, 2, , • • • , N 0 - 1 (12.95) 

0 r=0 

Note that H{e 3ru>oT \ — H a (jru o) are known [Eq. (12.94)]. We can use IFFT to 
compute the No values of h[fc]. From these values of h[k\, we can determine the 
filter transfer function H\z\ as 

N 0 - 1 

H[z\ = ^ h[k\z~ k (12.96) 

k-0 

Linear Phase (Constant Delay) Filters 

We desire that H a (ju>) = H[e 3wT \. The filter featured in Eqs. (12.95) and 
(12.96) satisfies this condition only at the No values of u. Between samples, the 
frequency response, especially the phase response, could deviate considerably. If 
we want a Unear phase characteristic, the procedure is slightly modified. First, we 
start with a zero phase (or a constant phase ± | ) response. For such a frequency 
response fc[fc] is an even (or odd) function of k (see Prob. 4.1-1). In either case, 
h [fc] is centered at k — 0. To realize this noncausal filter, we need to delay h[k] by 
(No - l)/2 units. Such a delay amounts to multiplying H\e^ T ] with 
Thus, the delay of h[k] does not alter the filter amplitude response, but the phase 
response changes by -(No - l)u>T/2, which is a linear function of w. Hence, we are 
assured that the filter is realizable (causal) and has a linear phase. Thus, if we wish 
to realize a frequency response H [e J “’ T ], we begin with H\eJ u,T \e~ 3 ~ 3 ^~‘ jT and find 
the IDFT of its Ng samples. The resulting IDFT at k = 0, 1, 2, 3, • ■ ■ , Af 0 — 1 is 
the desired impulse response, which is causal, and the corresponding phase response 
is linear. 

Note that wgT = and the No uniform samples of H [e 3 “ T )e~ 3 V wT are 

H r = H\e jr ^ T ]e- jT ^ woT 

= H je-'NT] (12.97) 

Recall that the No samples H r are the uniform samples of the periodic extension 
of H[ei“ T ]e~i u ' r . Hence, Eq. (12.97) applies to samples of the frequency range 
from 0 < u < y- The remaining samples are obtained by using the conjugate 
symmetry property H r — H^ o _ r . The desired h[k] is the IDFT of H r ; that is, 

1 Na ~ 1 

h[k] = ~ Y' H r e ^ k = 0, 1, 2, ••-,«<) - 1 (12.98) 

0 , — n 


and 


| 
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Fig. 12.21 Lowpass filter design using the frequency sampling method. 


N 0 -l 

H[z\ = ^ h[k]z~ k (12.99) 

*= o 

This procedure will now be explained by an example. 

■ Example 12.12 

Using the frequency sampling method, design a sixth-order nonrecursive ideal lowpass 
filter of cutoff frequency real/s. 

The frequency response ff[e J “ T ] of an ideal lowpass filter is shown (shaded) in Fig. 
12.21. In this case 

_ No - 1 6 2x 27 r 

JV ° = 7 ’ ^T = 7’ W0= N^ = 7T 
The seven samples H r in Eq. (12.97) are 

[ • 2nr "1 - 6 

e*'rr\ e -J*T- 

Thus 

Ho = 1, Hi = e~ j6 f , H 2 = H 3 = 0 

The remaining three samples should be determined using the conjugate property of DFT, 
H r — Htf 0 _ r , that is H r = Hj_ r . Thus 

Ht = Hi = 0, Hi = Hi = 0, Ho = Hi = 


The desired h[k] is the IDFT of H r given by [Eq. (12.98)] 

6 

h\k\ = k = 0, 1, 2, 3, ■■■, 6 

r=0 

We may compute this IDFT by using the IFFT algorithm or by straightforward 
substitution of values of H r in the above equation as 
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M°] = \Y, Hr = ^ +e-^ /7 + e 36 '/ 7 ] = i (l + 2cos y) = -0.1146 

r= 0 

h[l] = i = 7 1 1 + e~ i4,r/7 Te*’' 7 ] = i (l + 2 cos y) = 0.0792 

r=0 

h[2] = i ^Hre^ =y [1 + e“ j2,r/7 + e j2,r/7 ] = i (l + 2 cos y) = 0.3209 


M3] = \Y, Hrei>¥ = ^t 1 + 1 + !] = °' 4 


Similarly, we can show that 

h[4] = 0.3209, h[5] = 0.0792, and h[6] = -0.01146 

Observe that h[k] is symmetrical about its center point k = 3 as expected. Compare these 
values with those found by the impulse invariance method in Table 12.3 for a rectangular 
window. Although the two sets of values are different, they are comparable. What is the 
difference in the two filters? The impulse invariance filter optimizes the design with respect 
to all frequencies. It minimizes the mean squared value of the difference between the desired 
and the realized frequency response. The frequency sampling method, in contrast, realizes 
a filter whose frequency response matches exactly to the desired frequency response at 
No uniformly spaced frequencies. The mean squared error in this design will generally be 
higher than that in the impulse invariance method. 

The filter transfer function is 


: -0.1146 + 


0.0792 0.3209 0.4285 0.3209 0.0792 0.1146 

1 1 1 1 


_ — 0.1146z 6 + 0.0792z 5 + 0.3209z 4 + 0.4285z 3 + 0.3209z 2 + 0.0792z - 0.1146 


H[e jwT ] = -0.1146 + 0.0792e~ 


+ 0.4285e - 


+ 0.3209e -j4u ' T + 0.0792e -i5 “' r - 0.1146e i6 " r 
= e~ j3 “ T [0A285 + 0.6418cos uT + 0.1584cos 2wT - 0.2292 cos 3u>T] 

The magnitude of this response (Fig. 12.21) shows that the realized filter values match 
exactly the desired response at the No sample points. The time delay adds a linear phase 
— 3Tw to the filter characteristic. I 

Q Computer Example C12.ll 

Using MATLAB, find h[k] and the corresponding R[e-'" r ] for the frequency sampling 
filter in Example 12.12. 

N0=7; 

H=[l 1 0 0 0 0 1]; 
for i=l:N0 
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r== i-1; 

Hr(i)=H(i)*exp(-j*r*pi*(NO-l)/NO); 

end 

k=0:6 

hk=ifft(Hr); 

subplot(2,l,l); 

stem(k,hk); 

xlabelCk’JjylabelChlk]’); 

M = 512 

hE=[hk zeros(l,M-7)] 

HE=fFt(hE); 

subplot(2,l,2); 

r=0:M-l; 

W=r.*2*pi/512 

plot(W,abs(HE)); 

xlabel(’W’);ylabel(’F(W)’);grid; Q 



( 12 . 100 ) 
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Observe that we do not need to perform IDFT (or IFFT) computations to obtain the 
desired filter transfer function. All we need is the values of the frequency samples 
H r , which are given. Equation (12.100) shows that the desired filter is realized as 
a cascade of two filters with transfer functions Hi[z] and H 2 [z). Also, H x [z] is the 
transfer function of an W 0 -order comb filter (see Example 12.9). The second filter 
with transfer function H 2 [z\ is a parallel combination of n + 1 first-order filters, 
whose poles lie on the unit circle at e J ^ (r = 0, 1, 2, ■ • • , N 0 - 1). For the lowpass 
or bandpass filters many coefficients H r appearing in H 2 [z] are zero. Recall that 
in Example 12.12 (lowpass filter) four out of seven coefficients are zero. Thus, in 
practice the final filter is usually much simpler than it appears in Eq. (12.100). As 
a result, this method may require a fewer number of computations (multiplications 
and additions) compared to those in the filter obtained by the direct method (using 
IDFT). v 8 

The poles of the frequency sampling filter are complex in general because they 
lie on the unit circle. Therefore, we must combine the conjugate poles to form 
quadratic transfer functions to realize them. All these points will be clarified by 
designing the filter in Example 12.12 by this method. 

H Example 12.13 

Redo Example 12.12 using the method of frequency sampling filter. 

In this case n = 6, N 0 = n + 1 = 7. Also 


H 2 = #3 = H 4 = Hi — 0 

and 

H 0 = 1, Hi — e‘ j6,r/7 , Ho = t^' 7 

Substituting these values in the transfer function #[2] of the desired filter in Eq. (12.100), 
we obtain 



«»W 


-j6*/7 


1 + z- 




: _ e -j2*/r 




We combine the last two terms on the right-hand side corresponding to complex conjugate 
poles to obtain 
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H 2 {z). However, H 2 [z\ is recursive (IIR). This strange fact should alert us to the 
possibility of something interesting going on in this filter. For a nonrecursive filter 
there can be no poles other than those at the origin [see Eq. (12.69a)]. In the 
frequency sampling filter [Eq. (12.100)], in contrast, H 2 [z] has N 0 poles at e jVn ° 
( r = fr Ij 2, * • - , n). All these poles lie on the unit circle at equally spaced points. 
These poles simply cannot be in a nonrecursive filter. They must somehow get 
canceled along the way somewhere. This is precisely what happens. The zeros of 
Hi [z] are exactly where the poles of H 2 [z] are because 

z N ° - 1 = (z - e i0jl o)(z - e 7T! ° )(z - e 72 ^) • • • (z - e 7n %o) 

Thus, the poles of H 2 [z\ are canceled by the zeros of II \\z], rendering the final filter 
nonrecursive. 

Pole-zero cancellation in this filter is a potential cause for mischief because 
such a perfect cancellation assumes exact realization of both H x [z} and H 2 [z). Such 
a realization requires the use of infinite precision arithmetic, which is a practical 
impossibility because of quantization effects. Imperfect cancellation of poles and 
zeros means there will still be poles on the unit circle, and the filter will not have a 
finite impulse response. More serious, however, is the fact that the resulting system 
will be marginally stable. Such a system provides no damping of the round-off noise 
that is introduced in the computations. In fact, such noise tends to increase with 
time, and may render the filter useless. 

We can partially mitigate this problem by moving both the poles (of H 2 {z\) and 
zeros (of Hi[z]) to a circle of radius r = 1 — e, where e is a small positive number 
— » 0. This artifice will make the overall system asymptotically stable. 

Spectral Sampling with Windowing 

The frequency sampling method can be modified to take advantage of win- 
dowing. We first design a frequency sampling filter using a value N 0 ' that is much 
higher than the design value TVo. The result is a filter that matches with the desired 
frequency response at a very large number {Ng') of points. Then we use a suitable 
Wo-point window to truncate the .V,/- point impulse response. This procedure yields 
the final design of a desired order. 


H[z\ = 





z z(2zcos ^ - 2cos y-)' 
2 - 1 z 2 — (2 cos ^z + 1) 

z 1.802z(z - 1) ' 

Z - 1 z 2 — 1.247z + 1 

HiW 


We can realize this filter by placing the comb filter Hi[z] in cascade with H 2 [z], which 
consists of a first-order and a second-order filter in parallel. I 


Pole-Zero Cancellation in Frequency Sampling Filters 

In the method of frequency sampling filters, we make an intriguing observation 
that the required nonrecursive (FIR) filter is realized by a cascade of Hi [z] and 


12.9 Summary 

The response of an LTID system with transfer function H[z ] to an everlasting 
sinusoid of frequency S2 is also an everlasting sinusoid of the same frequency. The 
output amplitude is |Ff [e J ' n ]| times the input amplitude, and the output sinusoid is 
shifted in phase with respect to the input sinusoid by lH[e in ] radians. The plot of 
\H [e Jlf! ]| vs 52 indicates the amplitude gain of sinusoids of various frequencies and is 
called the amplitude response of the system. The plot of lH[e jSl ] vs Q indicates the 
phase shift of sinusoids of various frequencies and is called the phase response. The 
frequency response of an LTID system is a periodic function of fl with period 2ir. 
This periodicity is the result of the fact that discrete-time sinusoids with frequencies 
differing by an integral multiple of 2ir are identical. 

Frequency response of a system is determined by locations in the complex plane 
of poles and zeros of its transfer function. We can design frequency selective filters by 
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proper placement of its transfer function poles and zeros. Placing a pole (or a zero) 
near the point e jCt ° in the complex plane enhances (or suppresses) the frequency 
response at the frequency fl = fi 0 . Using this concept, a proper combination of 
poles and zeros at suitable locations can yield desired filter characteristics. 

Digital filters are classified into recursive and nonrecursive filters. The duration 
of the impulse response of a recursive filter is infinite; that of the nonrecursive filter 
is finite. For this reason, recursive filters are also called infinite impulse response 
(HR) filters, and nonrecursive filters are called finite impulse response (FIR) filters. 

Digital filters can process analog signals using A/D and D/ A converters. Pro- 
cedures for designing a digital filter that behaves like a given analog filter are dis- 
cussed. A digital filter can simulate the behavior of a given analog filter either 
in time-domain or in frequency-domain. This situation leads to two different de- 
sign procedures, one using a time-domain equivalence criterion and the other a 
frequency-domain equivalence criterion. 

For recursive or HR filters, the time-domain equivalence criterion yields the 
impulse invariance method, and the frequency-domain equivalence criterion yields 
the bilinear transformation method. The impulse invariance method is handicapped 
by the aliasing problem, and cannot be used for highpass and bandstop filters. 
The bilinear transformation method, which is generally superior to the impulse 
invariance method, suffers from the frequency scale warping effect. However, this 
effect can be neutralized by prewarping. 

For nonrecursive or FIR filters, the time-domain equivalence criterion leads to 
the method of windowing (Fourier series method), and the frequency-domain equiv- 
alence criterion leads to the method of frequency sampling. Because nonrecursive 
filters are a special case of recursive filters, we expect the performance of recursive 
filters to be superior. This statement is true in the sense that a given amplitude 
response can be achieved by a recursive filter of an order smaller than that required 
for the corresponding nonrecursive filter. However, nonrecursive filters have the 
advantage that it can realize an arbitrarily shaped amplitude response and a linear 
phase characteristic. Recursive filters are good for a piecewise constant amplitude 
response and they can realize linear phase only approximately. To realize a linear 
phase characteristic in nonrecursive filters, the impulse response h[k] must be either 
symmetric or antisymmetric about its center point. 


References 

1. Mitra, S.K., Digital Signal processing: A Computer-Based Approach, McGraw- 
Hill, New York, 1998. 

Problems 

12.1- 1 Find the amplitude and phase response of the digital filters depicted in Fig. P12.1-1. 

12.1- 2 Find the amplitude and the phase response of the filters shown in Fig. P12.1-2. 

Hint: Express H[e jn ] as e“ j2 " c,n // a [e jfi ]. 

12.1- 3 For an LTID system specified by the equation 

y\k + 1] - 0.5y[fc] = f[k + 1] + 0.8/[k] 

(a) Find the amplitude and the phase response. 

(b) Find the system response j/[fc] for the input f[k] = cos (0.5fc — f ). 



(a) 




(c) 


Fig. P12.1-1. 




12.1- 4 For an asymptotically stable LTID system, show that the steady-state response to in- 

put e jnk u[k] is H[e> n ]e ink u\k]. The steady-state response is that part of the response 
which does not decay with time and persists forever. 

Hint: Follow the procedure parallel to that used for continuous-time systems in Sec. 

7.1-1. 

12.1- 5 (a) A digital filter has the sampling interval T = 50 ps. Determine the highest 
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frequency that can be processed by this filter without aliasing. 

(b) If the highest frequency to be processed is 50 kHz, determine the minimum value 
of the sampling frequency '} , . and the maximum value of the sampling interval T 
that can be used. 

12.2-1 Pole-zero configurations of certain filters are shown in Fig. P12.2-1. Sketch roughly 
the amplitude response of these filters. 



(a) (b) 

Fig. P12.2-1. 


12.2- 2 (a) Realize a digital filter whose transfer function is given by 

H{z\ = K — 

z - a 

(b) Sketch the amplitude response of this filter, assuming |a| < 1. 

(c) The amplitude response of this lowpass filter is maximum at fl = 0. The 3-dB 
bandwidth is the frequency where the amplitude response drops to 0.707 (or 1/-/2) 
times its maximum value. Determine the 3-dB bandwidth of this filter when a = 0.2. 

12.2- 3 Design a digital notch filter to reject frequency 5000 Hz completely, and to have a 

sharp recovery on either side of 5000 Hz to a gain of unity. The highest frequency to 
be processed is 20 kHz (Th = 20,000). Hint: See Example 12.3. The zeros should be 
at e ±}u,T for ui corresponding to 5000 Hz, and the poles are at ae ±ju,T with a < 1. 
Leave your answer in terms of a. Realize this filter using the canonical form. Find 
the amplitude response of the filter. 

12.2- 4 Show that a first-order LTID system with a pole at z = r and a zero at z = A (r < 1) 

is an allpass filter. In other words, show that the amplitude response |7f[e^ n ]| of a 
system with the transfer function 

z- 1 

H[z) = r. r < i 

z — r 

is constant with frequency. This is a first-order allpass filter. 

Hint: Show that the ratio of the distances of any point on the unit circle from the 
zero (at z ~ £) and the pole (at z = r) is a constant £. 

Generalize this result to show that an LTID system with two poles at z — re ±30 and 
two zeros at z = \e ±30 (r < 1) is an allpass filter. In other words, show that the 
amplitude response of a system with the transfer function 

H \z\ = (* - _ z 2 - (f cos 9)z + ? 

(z - rei 8 )(z - re~i e ) z 2 - (2r cos 8)z + r 2 T ~ 
is constant with frequency. 
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12.4-1 


12.5-1 


12.5-2 


12.5-3 


12.5-4 


12.5-5 


(a) A lowpass digital filter with a sampling interval T = 50 ps has a cutoff frequency 
10 kHz. If the value of T in this filter is changed to 25 ps, determine the new cutoff 
frequency of the filter. Repeat the problem if T is changed to 100 ns. 

(a) Using the impulse invariance criterion, design a digital filter to realize an analog 
filter with transfer function 

„ , , 7s + 20 

2(s 2 + 7s + 10) 

Assume the filter to be bandlimited to the frequency where the gain drops to about 
1% of its maximum value. 

(b) Show a canonical and a parallel realization of the filter. 

Using the impulse invariance criterion, design a digital filter to realize the second- 
order analog Butterworth filter with transfer function 


H a (s) 


1 

s 2 + v/2 s + 1 


Assume the filter to be bandlimited to the frequency where the gain drops to 1% of 
its maximum value. 


Design a digital integrator using the impulse invariance method. Find and sketch the 
amplitude response, and compare it with that of the ideal integrator. If this integrator 
is used primarily for integrating audio signals (whose bandwidth is 20 kHz), determine 
a suitable value for T. 


An oscillator by definition is a source (no input) which generates a sinusoid of a 
certain frequency uo- Therefore an oscillator is a system whose zero-input response 
is a sinusoid of the desired frequency. Find the transfer function of a digital oscillator 
to oscillate at 10 kHz, by two methods: 

(a) Choose H[z\ directly so that its zero-input response is a discrete- time sinusoid of 
frequency Cl = wT corresponding to 10 kHz. 

(b) Choose H a (s) whose zero-input response is an analog sinusoid of 10 kHz. Now 
use the impulse invariance method to determine H[z], 

In both methods select T so that there are 10 samples in each cycle of the sinusoid. 

(c) Show a canonical realization of the oscillator. 


A variant of the impulse invariance method is the step invariance method of digital 
filter synthesis. In this method, for a given H a (s), we design H[z ] in Fig. 12.8a such 
that y(kT) in Fig. 12.8b is identical to y[fc] in Fig. 12.8a when f{t) = u(t). 

(a) Show that in general 



(b) Using this method, design H[z ] when 


ffa(s) = 


C O c 

S + UJ C 


(c) Synthesize a discrete-time integrator using the step invariant method and compare 
its amplitude response with that of the ideal integrator. 

12.5- 6 Synthesize a discrete-time differentiator and integrator, using the ramp invariance 

method. In this method, for a given H a (s ), we design H[z] such that y(kT) in Fig. 
12.8b is identical to y[fc] in Fig. 12.8a when /(£) = tu(t). 

12.5- 7 In an impulse invariance design, show that if H a (s) is a transfer function of a stable 

system, the corresponding H[z] is also a transfer function of a stable system. 
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A pole of H a (s) at s = s* is transformed into a pole of H [z] a t z = zi = e s<t . Show 
that if Re Si < 0, then \zi\ < 1. 

12.6- 1 (a) Design a digital differentiator, using the bilinear transformation. 

(b) Show a realization of this filter. 

(c) Find and sketch the amplitude response of this filter and compare it with that of 
the ideal differentiator. 

(d) If this filter is used primarily for processing audio signals (voice and music) up 
to 20 kHz, determine a suitable value for T. 

12.6- 2 Repeat Prob. 12.6-1 for a digital integrator. 

12.6- 3 Design a digital lowpass Butterworth filter using the bilinear transformation with 

prewarping to satisfy the following specifications: G p = —2 dB, G s = —11 dB, 
Up = IOOtt rad/s, and t o s = 2007T rad/s. The highest significant frequency is 250 Hz. 
It is desirable to oversatisfy (if possible) the requirement of G a - 

12.6- 4 Repeat Prob. 12.6-3 for a chebyshev filter. 

12.6- 5 Design a digital highpass Butterworth filter using the bilinear transformation with 

prewarping to satisfy the following specifications: G p = —2 dB, G s — —10 dB, 
Up = 1507T rad/s, and u B = 1007T rad/s. The highest significant frequency is 200 Hz. 

12.6- 6 Repeat Prob. 12.6-5 for a chebyshev filter. 

12.6- 7 Design a digital bandpass Butterworth filter using the bilinear transformation with 

prewarping to satisfy the following specifications: G p = —2 dB, G s = —12 dB, 
u Pl = 120 rad/s, u P2 = 300 rad/s, and u Sl — 45 rad/s, u 8l = 450. The highest 
significant frequency is 500 Hz. 

12.6- 8 Repeat Prob. 12.6-7 for a chebyshev filter. 

12.6- 9 Design a digital bandstop Chebyshev filter using the bilinear transformation with 

prewarping to satisfy the following specifications: G p = — 1 dB, G a = — 22 dB, 
u Pl = 40 rad/s, u P2 — 195 rad/s, and u> Sl = 80 rad/s, u ai = 120. The highest 
significant frequency is 200 Hz. 

12.6-10 The bilinear transformation is actually a one-to-one mapping relationship between 
the s-plane and the 2 -plane. Show that the transformation 


maps the ju;-axis in the s-plane into a unit circle in the 2 -plane. The LHP and 
the RHP of the s-plane map into the interior and the exterior, respectively, of the 
unit circle in the 2 -plane. Show that if H a {s) represents a stable system, then the 
corresponding H[z] also represents a stable system. 

Hint: s = a + ju and z = (K + s)/(K + s). 

12.7- 1 Show that the frequency response of a third-order (n = 3) FIR filter with the impulse 

response h[k] that is symmetric about its center point is given by 

H[^ uT ] = 2e~ jl - 5 “ T (h[l] cos ~ + h[0] cos ^) 
and for the antisymmetric case 

H[e juT ) = 2e j( 5- 1 ' 5 “' T) (fc[l) sin ~ + fc[0] sin ^) 

12.7- 2 Another form of comb filter is given by the transfer function 
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(a) Find the impulse response of this filter for n = 6. 

(b) Find canonical realization of this filter. 

(c) Find and sketch the amplitude and phase response of this filter. 

12.8- 1 (a) Design a nonrecursive (FIR) filter with n = 14 to approximate an ideal lowpass 

filter with a cutoff frequency at 20 kHz. Use the sampling frequency T, = 200 kHz. 
(b) Modify the design in (a), using the Hamming window. 

12.8- 2 Using the impulse invariance method, design a tenth-order (n = 10) nonrecursive 

(FIR) filter to approximate the ideal bandpass characteristic depicted in Fig P12.8- 
2. Use T = 2 x 10~ 3 . 



Fig. P12.8-2 


12.8- 3 Determine |H[e J " r ]|, using the von Hann window for a fifth-order nonrecursive (FIR) 

filter in Example 12.10 (to approximate an ideal lowpass filter) and for the tenth-order 
nonrecursive filter in Example 12.11 (to approximate an ideal differentiator). 

12.8- 4 An ideal rr/2 phase shifter (also known as the Hilbert transformer) is given by 

f -3 0 < w < v/T 

Ha(ju) = f 

l j 0 > u > -7 r/T 

(a) Sketch | H a (jui)\ and lH a (ju). 

(b) Using the impulse invariance method, design a fourteenth-order (N = 14) non- 
recursive (FIR) filter to approximate H a (jw). Determine the resulting |H[e-’" T ]| and 
ZH[e Jwr ], using the rectangular and the Hamming windows. 

12.8- 5 Design a tenth-order digital differentiator in Example 12.11 using the frequency sam- 

pling method. Compare the values of this design with those found in Example 12.11 
using the impulse invariance method. 
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State-Space Analysis 


So far we have been describing systems in terms of equations relating certain 
output to an input (the input-output relationship). This type of description is 
an external description of a system (system viewed from the input and output 
terminals). As noted in Chapter 1, such a description may be inadequate in some 
cases, and we need a systematic way of finding system’s internal description. State 
space analysis of systems meets this need. In this method, we first select a set of 
key variables, called the state variables, in the system. The state variables have 
the property that every possible signal or variable in the system at any instant t 
can be expressed in terms of the state variables and the input (s) at that instant t. 
If we know all the state variables as a function of t , we can determine every possible 
signal or variable in the system at any instant with a relatively simple relationship. 
The system description in this method consists of two parts: 

1 Finding the equation(s) relating the state variables to the input(s) (the state 
equation). 

2 Finding the output variables in terms of the state variables (the output equa- 
tion). 

The analysis procedure, therefore, consists of solving the state equation first, 
and then solving the output equation. The state space description is capable of 
determining every possible system variable (or output) from the knowledge of the 
input and the initial state (conditions) of the system. For this reason it is an internal 
description of the system. 

By its nature, the state variable analysis is eminently suited for multiple-input, 
multiple-output (MIMO) systems. In addition, the state-space techniques are useful 
for several other reasons, including the following: 

1 . Time-varying parameter systems and nonlinear systems can be characterized 
effectively with state-space descriptions. 

2. State equations lend themselves readily to accurate simulation on analog or 
digital computers. 

3. For second-order systems (n = 2), a graphical method called phase-plane 
analysis can be used on state equations, whether they are linear or nonlinear. 


4. State equations can yield a great deal of information about a system even when 

they are not solved explicitly. 

This chapter requires some understanding of matrix algebra. Section B.6 is a 
self-contained treatment of matrix algebra, which should be more than adequate 
for the purposes of this chapter. 

13.1 Introduction 

From the discussion in Chapter 1, we know that to determine a system’s re- 
sponse(s) at any instant t, we need to know the system’s inputs during its entire 
past, from — oo to t. If the inputs are known only for t > to, we can still determine 
the system output(s) for any t > to, provided we know certain initial conditions 
in the system at t = to- These initial conditions collectively are called the initial 
state of the system (at t = to). 

The state of a system at any instant to is the smallest set of numbers xj(to), 
X 2 (to), ■ ■ ■ , x„(to) which is sufficient to determine the behavior of the system for 
all time t > to when the input(s) to the system is known for t > to. The variables 
xi, X 2 , ... , x„ are known as state variables. 

The initial conditions of a system can be specified in many different ways. 
Consequently, the system state can also be specified in many different ways. This 
means that state variables are not unique. The concept of a system state is very 
important. We know that an output y(t) at any instant t > to can be determined 
from the initial state {z(<o)} and a knowledge of the input /(t) during the interval 
(to, t). Therefore, the output y(to) (at t = to) is determined from the initial state 
{x (t 0 )} and the input / (t) during the interval (to, to). The latter is /(to). Hence, the 
output at any instant is determined completely from a knowledge of the system state 
and the input at that instant. This result is also valid for multiple-input, multiple- 
output (MIMO) systems, where every possible system output at any instant t is 
determined completely from a knowledge of the system state and the input(s) at 
the instant t. These ideas should become clear from the following example of an 
RLC circuit. 

I Example 13.1 

Find a state-space description of the RLC circuit shown in Fig. 13.1. Verify that 
all possible system outputs at some instant t can be determined from a knowledge of the 
system state and the input at that instant t. 

It is known that inductor currents and capacitor voltages in an RLC circuit can be 
used as one possible choice of state variables. For this reason, we shall choose xi (the 
capacitor voltage) and X 2 (the inductor current) as our state variables. 

The node equation at the intermediate node is 

iz — ii — i? — X2 

but *3 = 0.2xr, ii = 2 (/ - xi), 12 = 3xi. Hence 

0.2ii = 2 (/ — xi) — 3xi — X 2 
or 
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xi = —25xi - 5 x 2 + 10/ 
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Fig. 13.1 RLC network for Example 13.1. 


This is the first state equation. To obtain the second state equation, we sum the voltages 
in the extreme right loop formed by C, L, and the 2 f! resistor so that they are equal to 
zero: 

— xi +12 + 2x 2 - 0 
or 


X2 ~ Xl — 1X2 


Thus, the two state equations are 

ii = ~25xi - 5x2 + 10/ (13.1a) 

X2 = XI - 2X2 (13.1b) 

Every possible output can now be expressed as a linear combination of xi, X 2 , and /. 
From Fig. 13.1, we have 

»i = / - xi 
*i = 2(/-xi) 


One possible set of initial conditions is y(0), y(0), . . . , j/ n-1 )( 0). Let us define y, 
■y, y, ... , y l ' n ~ 1 ^ as the state variables and, for convenience, let us rename the n 
state variables as xj, X 2 , . . . , x n : 


xi = y 
x 2 = y 


X 3 = ii 


x n = y 


(n-l) 


(13.4) 


According to Eq. (13.4), we have 


xi — X2 
X2 = X 3 


Xn— 1 


and, according to Eq. (13.3), 

x n — —a n —ix n — a n _ 2 Xn— i — ... — aiX 2 — floxi -b f (13.5a) 

These n simultaneous first-order differential equations are the state equations 
of the system. The output equation is 

y — xi (13.5b) 


V2 = Xl 

%2 — 3xi 


For continuous- time systems, the state equations are n simultaneous first-order 
differential equations in n state variables xi, X 2 , • • • , x n of the form 


h = i\ - i 2 - X 2 = 2 (/ - xi) - 3xi - X 2 = -5xi -12 +2/ 


*4 — X2 

V 4 = 2^4 — 2x2 

V 3 — Xl — V 4 — X\ — 2X2 (13.2) 


This set of equations is known as the output equation of the system. It is clear from 
this set that every possible output at some instant t can be determined from a knowledge 
of xi(t), x 2 (t), and f(t), the system state and the input at the instant t. Once we solve the 
state equations (13.1) to obtain xi(t) and x 2 (t), we can determine every possible output 
for any given input f(t). I 


If we already have a system equation in the form of an nth-order differential 
equation, we can convert it into a state equation as follows. Consider the system 
equation 


d n y , d^y 
dt n an_1 df n_1 


+ • • ■ + 01 ^ + a 0 y = /(<) 
at 


(13.3) 


Xi = ffi(xi,x 2 , . . .,X„, fufi,... ,fj) i = 1,2, .. . ,n 

where /i, / 2 , ... , f n are the j system inputs. For a linear system, these equations 
reduce to a simpler linear form 


Xi = dilXi + a t 2 X 2 + • • ■ + aknXn + &il/l + &i2/2 + • • • + 5i jfj 


and the output equations are of the form 


k = 1, 2, . . . , n 
(13.6a) 


Vm — c m iXi + c m2 x 2 + • • • + c mn x n + dmi/i "b d m 2 f 2 T ■ • • + d m jfj m 1, 2, . . . , k 

(13.6b) 

The set of Equations (13.6a) and (13.6b) is called a dynamical equation. When 
it is used to describe a system, it is called the dynamical-equation description 
or state-variable description of the system. The n simultaneous first-order state 
equations are also known as the normal-form equations. 

These equations can be written more conveniently in matrix form: 
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or 


x = Ax + Bf (13.8a) 

y = Cx + Df (13.8b) 

Equation (13.8a) is the state equation and Eq. (13.8b) is the output equation. The 
vectors x, y, and f are the state vector, the output vector, and the input vector, 
respectively. 

For discrete-time systems, the state equations are n simultaneous first-order 
difference equations. Discrete-time systems are discussed in Sec. 13.6. 


13.2 A Systematic Procedure for Determining State Equations 

We shall discuss here a systematic procedure for determining the state-space 
description of linear time-invariant systems. In particular, we shall consider two 
types of systems: (1) RLC networks and (2) systems specified by block diagrams 
or nth-order transfer functions. 

13.2-1 Electrical Circuits 

The method used in Example 13.1 proves effective in most of the simple cases. 
The steps are as follows: 

1. Choose all independent capacitor voltages and inductor currents to be the 
state variables. 

2. Choose a set of loop currents; express the state variables and their first 
derivatives in terms of these loop currents. 


13.2 A Systematic Procedure for Determining State Equations 
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Fig. 13.2 RLC network for Example 13.2. 


3. Write the loop equations and eliminate all variables other than state vari- 
ables (and their first derivatives) from the equations derived in Steps 2 and 3. 

I Example 13.2 

Write the state equations for the network shown in Fig. 13.2. 

Step 1. There is one inductor and one capacitor in the network. Therefore, we shall 
choose the inductor current xi and the capacitor voltage X 2 as the state variables. 

Step 2. The relationship between the loop currents and the state variables can be 
written by inspection: 

x\ = i 2 (13.9a) 

\x2 — i2 - h (13.9b) 

Step 3. The loop equations are 


II 

cs 

cs 

1 

•■5 

(13.10a) 

2(»2 - h) + ii + X2 = 0 

(13.10b) 

— X2 + 3t3 = 0 

(13.10c) 


Now we eliminate ii, 12 , and from Eqs. (13.9) and (13.10) as follows. From Eq. (13.10b), 
we have 

XI = 2(zi - 12 ) - X2 

We can eliminate ii and 22 from this equation by using Eqs. (13.9a) and (13.10a) to obtain 

£1 = -xi - x 2 + 5/ 

The substitution of Eqs. (13.9a) and (13.10c) in Eq. (13.9b) yields 

X2 = 2xi — |x2 

These are the desired state equations. We can express them in matrix form as 



(13.11) 


The derivation of state equations from loop equations is facilitated considerably by 
choosing loops in such a way that only one loop current passes through each of the inductors 
or capacitors. H 
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An Alternative procedure 

We can also determine the state equations by the following procedure: 

1. Choose all independent capacitor voltages and inductor currents to be the 
state variables. 

2. Replace each capacitor by a fictitious voltage source equal to the capacitor 
voltage, and replace each inductor by a fictitious current source equal to the inductor 
current. This step will transform the RLC network into a network consisting only 
of resistors, current sources, and voltage sources. 

3. Find the current through each capacitor and equate it to Cij, where i, is 
the capacitor voltage. Similarly, find the voltage across each inductor and equate 
it to Lij, where Xj is the inductor current. 


2Q I £1 



Fig. 13.3 Equivalent circuit of the network in Fig. 13.2. 


■ Example 13.3 

Using the above procedure, write the state equations for the network in Fig. 13.2. 

In the network in Fig. 13.2, we replace the inductor by a current source of current xi 
and the capacitor by a voltage source of voltage 22 , as shown in Fig. 13.3. The resulting 
network consists of five resistors, two voltage sources, and one current source. We can 
determine the voltage vl across the inductor and the current i c through the capacitor by 
using the principle of superposition. This step can be accomplished by inspection. For 
example, vl has three components arising from three sources. To compute the component 
due to /, we assume that 21 = 0 (open circuit) and 22 = 0 (short circuit). Under these 
conditions, all of the network to the right of the 2 fl resistor is opened, and the component 
of vl due to / is the voltage across the 2 fl resistor. This voltage is clearly \f. Similarly, 
to find the component of vl due to 21 , we short / and 22 . The source 21 sees an equivalent 
resistor of lfl across it, and hence vi = — * 1 . Continuing the process, we find that the 
component of vl due to 22 is — 22 - Hence 


vl = xi — -f - 21 - 22 


(13.12a) 


Using the same procedure, we find 


1 . 1 
«c = 2 X 2 — X 1 - J X 2 


(13.12b) 
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These equations are identical to the state equations (13.11) obtained earlier.) ■ 

13.2-2 State Equations From Transfer Function 

It is relatively easy to determine the state equations of a system specified by 
its transfer function. Consider, for example, a first-order system with the transfer 
function 

H(s) = —j— (13.13) 

The system realization appears in Fig. 13.4. The integrator output serves as a 
natural state variable since, in practical realization, initial conditions are placed on 
the integrator output. From Fig. 13.4, we have 

x = -ax + / (13.14a) 

y = x (13.14b) 



Fig. 13.4 


In Sec. 6.6 we saw that a given transfer function can be realized in several ways. 
Consequently, we should be able to obtain different state-space descriptions of the 
same system by using different realizations. This assertion will be clarified by the 
following example. 

H Example 13.4 

Determine the state-space description of a system specified by the transfer function 


Hi") — 2s + 10 

' ' s 3 + 8s 2 + 19s + 12 

(13.15a) 

_ / 2 N/ s + 5\/ i \ 

(13.15b) 

^s + lj\ v s + 3j\s + 4 y / 

4 0 2 

- _3 , 3 

5 + 1 S + 3 S + 4 

(13.15c) 


fThis procedure requires modification if the system contains all-capacitor voltage source tie sets 
or all-inductor current source cut sets. In the case of all-capacitor voltage source tie sets, all 
capacitor voltages cannot be independent. One capacitor voltage can be expressed in terms of 
the remaining capacitor voltages and the voltage source(s) in that tie set. Consequently, one of 
the capacitor voltages should not be used as a state variable, and that capacitor should not be 
replaced by a voltage source. Similarly, in all-inductor current source tie sets, one inductor should 
not be replaced by a current source. If there are all-capacitor tie sets or all-inductor cut sets only, 
no further complications occur. In all-capacitor-voltage source tie sets and/or all-inductor-current 
source cut sets, we have additional difficulties in that the terms involving derivatives of the input 
may occur. This problem can be solved by redefining the state variables. The final state variables 
will not be capacitor voltages and inductor currents. 



Fig. 13.5 Canonical, cascade, and parallel realizations of the system in Example 13.4. 
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Fig. 13.5 Canonical, cascade, and parallel realizations of the system in Example 13.4. 
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Using the procedure developed in Sec. 6.6, we shall realize H(s) in Eq. (13.15) with 
four different realizations: (i) the controller canonical form [Eq. (13.15a)), (ii) the observer 
canonical form [Eq. (13.15a)), (iii) cascade realization [Eq. (13.15b)] and (iv) parallel re- 
alization [Eq. (13.15c)]. These realizations are depicted in Figs. 13.5a, 13.5b, 13.5c, and 
13. 5d, respectively. As mentioned earlier, the output of each integrator serves as a natural 
state variable. 

1. Canonical Forms 

Here we shall realize the system using the first (controller) canonical form discussed 
in Sec. 6.6-1. If we choose the state variables to be the three integrator outputs zi, X2, 
and X3, then, according to Fig. 13.5a, 



and the output y is given by 
Hence 

t>i“ 

V2 
t>3_ 



(13.18b) 

(13.19a) 
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and 

Dl 

V2 

V3 

Observe closely the relationship between the state-space descriptions of H ( s ) that use 
the controller canonical form [Eqs. (13.17)] and those using the observer canonical form 
[Eqs. (13.19)]. The A matrices in these two cases are the transpose of one another; also, 
the B of one is the transpose of C in the other, and vice versa. Hence 

(A) T = A 

(B) t = C (13.20) 

(C) r = B 

This is no coincidence. This duality relation is generally true . 1 



(13.19b) 


2. Series Realization 

The three integrator outputs wi, m 2 , and m 3 in Fig. 13.5c are the state variables. 
The state equations are 

wi — -wi + / (13.21a) 

w 2 = 2wi — 3 u>2 (13.21b) 


and the output equation is 


li >3 = 5W2 +W2 — 4W3 
y = W 3 


(13.21c) 


The elimination of m from Eq. (13.21c) by using Eq. (13.21b) converts these equations 
into the desired state form 


and 



(13.22a) 


(13.22b) 


3. Parallel Realization (Diagonal Representation) 

The three integrator outputs 21 , 22 , and 23 in Fig. 13. 5d are the state variables. The 
state equations are 


21 = -zi + / 

22 = -322 + f 

23 = -423 + / 


(13.23a) 


13.2 A Systematic Procedure for Determining State Equations 
and the output equation is 

y = fzi - 222 + §23 

Therefore, the equations in the matrix form are 



795 

(13.23b) 

(13.24a) 

(13.24b) 


O Computer Example C13.1 

Solve Example 13.4 using MATLAB. 

Caution: The convention of MATLAB for labeling state variables xi, X 2 , . . . , x„ in a 
block diagram, such as shown in Fig. 13.5a, is reversed. What we label xi is x„, and X 2 is 
x„-i, and so on. 

num=[2 10]; den=[l 8 19 12]; 

[A,B,C,D]=tf2ss(num,den) 

% In order to find the transfer function from A, B, C, and D, use 
[num, den]=ss2tf(A,B,C,D) 
printsys(num,den) Q 

A General Case 

It is clear that a system has several state-space descriptions. Notable among 
these are the canonical-form variables and the diagonalized variables (in the parallel 
realization). State equations in these forms can be written immediately by inspec- 
tion of the transfer function. Consider the general nth-order transfer function 


bmS m + h m _is m 1 + - • • + b\s + bo 
s n + o n _ is n_1 H b aj s + ao 

b m s m + b m -is m 1 -j- ■ ■ ■ + b\s T bo 
(s - Ai )(s - A 2 ) • • • (s - A„) 

fcj ^2 ^ fen 

s — Ai s — A 2 s — X n 


(13.25a) 


(13.25b) 


Figures 13.6a and 13.6b show the realizations of H(s), using the controller 
canonical form [Eq. (13.25a)] and the parallel form [Eq. (13.25b)], respectively. 

The n integrator outputs xi, X 2 , . . . , x„ in Fig. 13.6a are the state variables. 
It is clear that 


i 1 = 12 
±2 = x 3 


in—1 2-n 


(13.26a) 


X n — 0. n —\X n &n— 2%n~l 


a 1 X 2 — cioxi 4- / 
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Fig. 13.6 Controller canonical and parallel realizations for an nth order LHC system, 
and output y is 

y = b 0 xi + biX 2 A 1- b m x m+1 (13.26b) 




and 


13.2 A Systematic Procedure for Determining State Equations 
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y = [b 0 b i ■ • • b m 



(13.27b) 


Observe that these equations (state equations and output equation) can be written 
immediately by inspection of H(s). 

The n integrator outputs zi, Z 2 , • • • , z n in Fig. 13.6b are the state variables. 
It is clear that 


and 

or 


zi — Ajzj + / 

z 2 = A 2 Z2 + / 


z n — ^n z n ~t" / 


(13.28a) 


y = k \ zj + fc 2 z 2 H h k n z n 


(13.28b) 



and 


y = [ki k 2 ■■■ fc n -i 



(13.29b) 


The state equation (13.29a) and the output equation (13.29b) can be written 
immediately by inspection of the transfer function H(s ) in Eq. (13.25b). Observe 
that the diagonalized form of the state matrix [Eq. (13.29a)] has the transfer func- 
tion poles as its diagonal elements. The presence of repeated poles in H (s) will 
modify the procedure slightly. The handling of these cases is discussed in Sec. 6.6. 
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Fig. 13.7 Realization of a second-order system. 


It is clear from the above discussion that a state-space description is not unique. 
For any realization of H (s) using integrators, scalar multipliers, and adders, a corre- 
sponding state-space description exists. Since there are many possible realizations 
of H(s), there are many possible state-space descriptions. 

Realization 

Consider a second-order system with a single input /, a single output y, and 
two state variables, xx and x 2 - The system equations are 

il = ann + ai2X2 + f>i / 

X 2 = 021^1 + <*22*2 + f>2/ (13.30a) 

and 

y = cixi + C 2 X 2 + df (13.30b) 

Figure 13.7 shows the block diagram of the realized system. The initial conditions 
*1(0) and x 2 (0) should be applied at Ax and N 2 . This procedure can be easily 
extended to general multiple-input, multiple-output systems with n state variables. 

13.3 Solution of State Equations 

The state equations of a linear system are n simultaneous linear differential 
equations of the first order. We studied the techniques of solving linear differential 
equations in Chapters 2 and 6. The same techniques can be applied to state equa- 
tions without any modification. However, it is more convenient to carry out the 
solution in the framework of matrix notation. 


13.3 Solution of State Equations 
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13.3 Solution of State Equations 
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(si - A)X(s) = x(0) + BF(s) 

(13.32b) 

where I is the n x n identity matrix. From Eq. 13.32b, we have 



X(s) = (si - A) 1 [x(0) + BF(s)) 

(13.33a) 


= *(s)[x(0) + BF(s)] 

(13.33b) 

where 

*(s) = (si - A)” 1 

(13.34) 

Thus, 

from Eq. (13.33b), 



X(s) = 4(s)x( 0) + t(s)BF(s) 

(13.35a) 

and 

x(t)= + £- 1 [$(s)BF(s)) 

(13.35b) 


zero-input component zero-state component 



Equation (13.35b) gives the desired solution. Observe the two components of the 
solution. The first component yields x(t) when the input f(t) = 0. Hence the 
first component is the zero-input component. In a similar manner, we see that the 
second component is the zero-state component. 


Example 13.5 

Find the state vector x(t) for the system whose state equation is given by 


x = Ax + Bf 


where 


A = 


-12 | 
-36 -1 


B = 


f(t) = u(t) 


and the initial conditions are xi(0) = 2, X 2 ( 0 ) — 1. 

From Eq. (13.33b), we have 

X(s) = *(s)[x(0) + BF(s)] 

Let us first find #(s). We have 
(si - A) = s 


and 


1 O' 


-12 

2 ' 
3 


s + 12 

2 ' 
3 

0 1 . 


-36 

-1 


36 

S + 1 


$(s) = (si - A) -1 = 


«±1 


2/3 


(•+4)(»+9) (5+41(5+9) 

-36 5+12 

[ (5+4)(5+9) (s+4)(5+9) 


Now, x(0) is given as 

Also, F(s) = j, and 


*( 0 ) = 


BF(s) = 


■ 1 - 

3 

1 _ 

■ 1 * 
3s 

1 

S 

1 

. S - 


(13.36a) 


and 


x(0) + BF(s) 



' 63 + 1 • 
3s 

8±1 

3 


X(.) = #(.)[x(0) + BF(.)] 


r 2-i 

S + l 3 


6s+l 1 

(s+4)(s+9) (s+4)(5+9) 


3s 

-36 s + 12 


5±1 

L (s+4)(5+9) (5+4)(s+9) J 




2s 2 +3s+ 1 " 
s(s+4)(s+9) 

s-59 

(s+4)(s+9) . 


21 136 

25 _l 4S 

A ' »J.Q 


The inverse Laplace transform of this equation yields 


XI (t) 



X 2 (t) 


(-fe- 4 ‘+fe-^u(t) 



(13.36b) 


Q Computer Example C13.2 

Solve Example 13.5 using MATLAB. 
Caution: See caution in Example C13.1. 

A = [-12 2/3;-36 -1]; B=[l/3; 1]; 

C=[0 0]; D=0; 

x0=[2;l]; 

t=O:.01:3; t=t’; 

f=ones(length(t),l); 

[y,x]=lsim(A,B,C,D,f,t,xO); 

plot(t,x) © 


The Output 


The output equation is given by 


and 


y = 


Cx + Df 


Y(s) = CX(s) + DF(s) 


Therefore 


The substitution of Eq. (13.33b) into this equation yields 


802 


13 State-Space Analysis 


Y(s) = C{#(s)[x(0) + BF(s)]} + DF(s) 

= C#(s)x(0) + [C$(s)B + D]F(s) (13.37) 

s. y K ^ 

zero-input response zero-state response 

The zero-state response (that is, the response Y(s) when x(0)=0), is given by 

Y(s) = [C*(s)B + D]F(s) (13.38a) 

Note that the transfer function of a system is defined under the zero-state condition 
[see Eq. (6.53)]. The matrix C$(s)B + D is the transfer function matrix H(.s) 
of the system, which relates the responses yi, 3 / 2 , ■ , Vk to the inputs f\, fz, , 

fj- 

H(s) = C*(s)B + D (13.38b) 

and the zero-state response is 

Y{s) = H(*)F(s) (13.39) 

The matrix H(s) is a A: x j matrix (k is the number of outputs and j is the number 
of inputs). The ij'th element #„(«) of H (s) is the transfer function that relates the 
output yi(t) to the input 

B Example 13.6 

Let us consider a system with a state equation 

x 1 0 1 21 10/i 

= 4- 

X2 — 2 —3 X2 1 1 /2 

and an output equation 

I °1 T 1 f° °1 " 

21 a 

II +10 

22 /2 

0 2 j L J Lo lj L 

In this case, 



(13.40a) 


(13.40b) 



and 



(13.40c) 


$(s) = (si — A) -1 = 


2 s + 3 


s+3 1 

(»+l)(»+2) (.+l)(.+3) 


(s+l)(s+2) (>+l)(»+2) 


Hence, the treuisfer function matrix H(s) is given by 


13.3 Solution of State Equations 
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Q Computer Example C13.3 

Solve Example 13.6 using MATLAB. 

Caution: The common factor (s + 1) in two of the transfer functions in Eq. (13.42) 
are canceled. The MATLAB answer gives transfer function with common factor. 

A=[0 l;-2 -3]; B=[l 0;1 1]; 

C=[l 0;1 1;0 2]; D=[0 0;1 0;0 1]; 

[numl,denl]=ss2tf(A,B,C,D,l) 

[num2,den2]=ss2tf(A,B,C,D,2) Q 


Characteristic Roots (Eigenvalues) of a Matrix 

It is interesting to observe that the denominator of every transfer function in 
Eq. (13.42) is (s + l)(s + 2) with the exception of H 2 i(s) and H 2 i{s), where the 
cancellation of the factor (s + 1) occurs. This fact is no coincidence. We see that the 
denominator of every element of ${s) is |sl — A| because $(s) = (si -A) -1 , and the 
inverse of a matrix has its determinant in the denominator. Since C, B, and D are 
matrices with constant elements, we see from Eq. (13.38b) that the denominator 
of $(s) will also be the denominator of H(s). Hence, the denominator of every 
element of H(s) is ] .si — A|, except for the possible cancellation of the common 
factors mentioned earlier. In other words, the poles of all transfer functions of 
the system are also the zeros of the polynomial |sl - A|. Therefore , the zeros 
of the polynomial |«I - A| are the characteristic roots of the system. Hence, the 
characteristic roots of the system are the roots of the equation 


|sl — A] — 0 


(13.43a) 
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Since |sl - A| is an nth-order polynomial in s with n zeros Ai, A 2 , . . • , A n , we can 
write Eq. (13.43a) as 

[si - A| = s n 4 a„_is n+1 + • ■ • + o-is 4- ao 

= (s — Ai)(s — A 2 ) ■••(* — A n ) = 0 (13.43b) 


For the system in Example 13.6, 0 1 

1*1 - A| = 

Os -2-3 
s —1 
2 s + 3 
= s 2 + 3s 4 2 


Hence 


= (s 4 1)(«4 2) 

Ai = -1 and A 2 = -2 


(13.44a) 

(13.44b) 


Equation (13.43) is known as the characteristic equation of the matrix A, 
and Ai, A 2 , ... , A„ are the characteristic roots of A. The term eigenvalue, 
meaning “characteristic value” in German, is also commonly used in the literature. 
Thus, we have shown that the characteristic roots of a system are the eigenvalues 
(characteristic values) of the matrix A. 

At this point, the reader will recall that if A x , A 2 i • • - > are the poles of the 
transfer function, then the zero-input response is of the form 


y 0 (t) = cie Al ‘ 4 c 2 e A2t 4 • • • 4 c„e A "‘ (13.45) 

This fact is also obvious from Eq. (13.38). The denominator of every element of 
the zero-input response matrix C$(s)x(0) is |sl — A| = (s — Ai)(s - A 2 ) • • • (s — 
A n ). Therefore, the partial-fraction expansion and the subsequent inverse Laplace 
transform will yield a zero-input component of the form in Eq. (13.45). 


13.3-2 Time-Domain Solution of State Equations 


The state equation is 


x = Ax 4 Bf 


(13.46) 


We now show that the solution of the vector differential Equation (13.46) is 

x(t) = e At x(0) 4 f e A <‘- T) Bf(T) dr 1 

Jo 


(13.47) 


Before proceeding further, we must define the exponential of the matrix appearing 
in Eq. (13.47). An exponential of a matrix is defined by an infinite series identical 
to that used in defining an exponential of a scalar. We shall define 


Ah 2 A 3 t 3 

c At = 1 4 At -I — I gj L ' 


(13.48a) 


(13.48b) 



In Sec. B.6-3, we show that 
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|(PQ).fq + P§ 


Using this relationship, we observe that 

— [e — At x] = ( -e“ A 'V + e~ At x 
dV 1 \dt ) 

= - e - At Ax + e- A ‘x (13.54) 

We now premultiply both sides of Eq. (13.46) by e~ At to yield 

e - At x = e~ M Ax + e _At Bf (13.55a) 

or 

e' At x - e _At Ax = e - At Bf (13.55b) 

A glance at Eq. (13.54) shows that the left-hand side of Eq. (13.55b) is jj[e _At ]. 
Hence 

^ r —Atl —At tj p 

- [ e ] = e Bf 

The integration of both sides of this equation from 0 to t yields 


(13.54) 

(13.55a) 

(13.55b) 



e - At x|'= [ e~ Ar Bf(r) dr 

(13.56a) 

or 

Jo 



e- At x(f)-x( 0)= / e _Ar Bf(r) dr 

Jo 

(13.56b) 

Hence 




e~ At x = x(0) + f e _Ar Bf(r) dr 

Jo 

(13.56c) 


Premultiplying Eq. (13.56c) by e At and using Eq. (13.53b), we have 
x(t)= e A *x(0) + j\ A{t ~ T) Bf{T)dT 

zero-input component 


(13.57a) 


zero-state component 

This is the desired solution. The first term on the right-hand side represents x(t ) 
when the input }{t) — 0. Hence it is the zero-input component. The second term, 
by a similar argument, is seen to be the zero-state component. 

The results of Eq. (13.57a) can be expressed more conveniently in terms of the 
matrix convolution. We can define the convolution of two matrices in a manner 
similar to the multiplication of two matrices, except that the multiplication of two 
elements is replaced by their convolution. For example, 

7l /2I [91 92] r(/l*9l+/2*93) (/l *92 + /2 *94) 

* = 

fz /4J 1.93 94 J U /3 * 91 + /4 * 93) (/3 *92 + /4 *94). 

Using this definition of matrix convolution, we can express Eq. (13.57a) as 
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x(t) = e At x(0) + e At * Bf(t) (13.57b) 

Note that the limits of the convolution integral [Eq. (13.57a)] are from 0 to t. 
Hence, all the elements of e At in the convolution term of Eq. (13.57b) are implicitly 
assumed to be multiplied by u(t). 

The result of Eq. (13.57) can be easily generalized for any initial value of t. It 
is left as an exercise for the reader to show that the solution of the state equation 
can be expressed as 

x(t) = e A (*-*o) x ( to ) + f e A(s - T) Bf(r)<fr (13.58) 

Jto 

Determining e At 

The exponential e At required in Eq. (13.57) can be computed from the defini- 
tion in Eq. (13.51a). Unfortunately, this is an infinite series, and its computation 
can be quite laborious. Moreover, we may not be able to recognize the closed-form 
expression for the answer. There are several efficient methods of determining e At 
in closed form. It is shown in Sec. B.6-5 that for annxn matrix A, 

e At — /?oI + /3i A -I- /? 2 A 2 + • ■ • + &n~x A n 1 (13.59a) 

where 



and A,, A 2 , . . . , A„ are the n characteristic values (eigenvalues) of A. 

We can also determine e At by comparing Eqs. (13.57a) and (13.35b). It is clear 

that 

e At = £- 1 [$( s )] (13.59b) 

= £ _1 [(sl - A) -1 ] (13.59c) 

Thus, e At and $(s) axe a Laplace transform pair. To be consistent with Laplace 
transform notation, e At is often denoted by <f>(t), the state transition matrix 
(STM): 

e A( = m 

I Example 13.7 

Find the solution to the problem in Example 13.5 using the time-domain method. 
For this case, the characteristic roots are given by 

s + 12 -§ 

|sl - A| = = s 2 + 13s + 36 = (s + 4)(s + 9) = 0 

36 s + 1 
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Substitution for the above convolution integrals from the convolution table (Table 2.1) 
yields 


e At t Bf(t) = 




(& + m*- 4 ' ~ *«->(*) 


l(e- 4 ‘ - e- 9t ) U (t) 


(13.61b) 


The sum of the two components [Eq. (13.61a) and Eq. (13.61b)] now gives the desired 
solution for x(t): 


_1 21-4 1 , 136 -9t 

36 20 e “ r 45 e 


^3 e -- + fe -9.j u( 


(13.61c) 


This result is consistent with the solution obtained by using the frequency-domain method 
[see Eq. (13.36b)]. Once the state variables xi and X 2 are found for t > 0, all the remaining 
variables are determined from the output equation. H 

The Output 


The output equation is given by 

y(t) = Cx(t) + Df(t) 

The substitution of the solution for x [Eq. (13.57)] in this equation yields 

y(t) = C[e At x(0) + e At * Bf(t)] + Df(t) 

Since the elements of B are constants, 

e At * Bf(<) = e At B * f(t) 

With this result, Eq. (13.62a) becomes 

y(t) = C[e At x(0) + e A 'B * f(t)] + Df(t) l 


(13.62a) 


y(t) = C[e A< x(0) + e Ai B * f(t)] + Df(t) (13.62b) 

Now recall that the convolution of f(t) with the unit impulse 6(t) yields f(t). Let us 
define a j x j diagonal matrix S(t) such that all its diagonal terms are unit impulse 
functions. It is then obvious that 

«(<)*f(t) = f(0 

and Eq. (13.62b) can be expressed as 

y(t) = C[e At x(0) + e A, B * f(t)] + D«(t) * f (t) (13.63a) 

= Ce A( x(0) + [Ce A( B + D«(t)] * f (t) (13.63b) 


With the notation 4>(t) for e Af , Eq. (13.63b) may be expressed as 
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y(0 = C»(t)x(0) + [C^(t)B + Df>(t)]*f(t) (13.63c) 

zero-input response zero-state response 

The zero-state response; that is, the response when x(0) = 0, is 

y(t) = [C#(t)B + T>S(t)\ * f(t) (13.64a) 

= h(t) * f(t) (13.64b) 

where 

h(t) = C*(t)B + D«(t) (13.65) 

The matrix h(t) is a k x j matrix known as the impulse response matrix. The 
reason for this designation is obvious. The ij th element of h(f) is which 

represents the zero-state response yi when the input fj{t) — S(t) and when all other 
inputs (and all the initial conditions) are zero. It can also be seen from Eq. (13.39) 
and (13.64b) that 

£[h(t)] = H(s) 


■ Example 13.8 

For the system described by Eqs. (13.40a) and (13.40b), determine e At using Eq. 
(13.59b): 

t(t) = e At = 

This problem was solved earlier with frequency-domain techniques. From Eq. (13.41), 
we have 


_! (>+l)(»+2) <5+l)(5+2) 

-2 5 

. («+l)(a+2) (s+l)(s+2) _ 

r _2 1_ _1 1_ 

-1 s+1 b +2 s+1 s+2 


4>{t) = C- 


L 5 + 1 V 5+2 S+1 ' 5 + 2 j 

_ ‘ 2e _t — e _2t e -t — e~ 2t ' 

“ _ 2e -‘ + 2e- 2 ‘ — e _t + 2e _2t 

The same result is obtained in Sec. B.6-5 by using Eq. (13.59a) [see Eq. (B.84)]. 

Also, 6(t) is a diagonal j X j or 2 x 2 matrix: 

r«w o i 

0 6(t)J 

Substituting the matrices 6(t), C, D, and B [Eq. (13.40c)] into Eq. (13.65), we have 


h(t) =1 i ! 


-2e -< + 2e _ 


+ 10 


6(t ) 0 

0 6(t) 


= 6(4) + 2e“ 2 * e“ 2 ‘ 

_ — 6e _t + 8e _2t 6(f) - 2e“ 2t + 4e“ 2t . 
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The reader can verify that the transfer-function matrix H(s) in Eq. (13.42) is the Laplace 
transform of the unit-impulse response matrix h(t) in Eq. (13.66). H 

13.4 Linear Transformation of State Vectors 

In Sec. 13.1 we saw that the state of a system can be specified in several ways. 
The sets of all possible state variables must be related — in other words, if we are 
given one set of state variables, we should be able to relate it to any other set. We 
are particularly interested in a linear type of relationship. Let x\, 12 , ■ • ■ , x n and 
w\,w 2 , ... ,w n be two different sets of state variables specifying the same system. 
Let these sets be related by linear equations as 

“>1 = Pll^l + P 12^2 + • • • + Pln^n 
XV 2 = P 21 Z 1 +P22Z2 + b P2n x n 

(13.67a) 


Wn = Pnl x l + Pn 2*2 4 h Pnn x n 


Pll P12 Pin *1 

U>2 P21 P22 ' ’ ' P2n x 2 


(13.67b) 


Defining the vector w and matrix P, as shown above, we can write Eq. (13.67b) as 

w = Px (13.67c) 

and 

x = P _1 w (13.67d) 

Thus, the state vector x is transformed into another state vector w through the 
linear transformation in Eq. (13.67c). 

If we know w, we can determine x from Eq. (13.67d), provided that P -1 exists. 
This is equivalent to saying that P is a nonsingular matrix) (|P| yt 0). Thus, if P 
is a nonsingular matrix, the vector w defined by Eq. (13.67c) is also a state vector. 
Consider the state equation of a system 


x = Ax + Bf 


(13.68a) 


, w = Px (13.68b) 

then 

x = P -1 w 

(This condition is equivalent to saying that all n equations in Eq. (13.67a) are linearly independent; 
that is, none of the n equations can be expressed as a linear combination of the remaining equations. 
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and 

x = P _1 w 

Hence the state equation (13.68a) now becomes 

P“ x w = AP -1 w + Bf 
or 



w = PAP x w + PBf 

(13.68c) 


= Aw + Bf 

(13.68d) 

where 


A = PAP -1 

(13.69a) 

and 


B = PB 

(13.69b) 


Equation (13.68d) is a state equation for the same system, but now it is expressed 
in terms of the state vector w. 

The output equation is also modified. Let the original output equation be 
y = Cx + Df 

In terms of the new state variable w, this equation becomes 

y = C(P _1 w) + Df 
= Cw + Df 

where 

C = CP -1 (13.69c) 


H Example 13.9 

The state equations of a certain system are given by 



(13.70a) 


Find the state equations for this system when the new state variables wi and u >2 are 

Wl = Xl + X2 


or 


W2 — Xl — X2 



(13.70b) 


According to Eq. (13.70b), the state equation for the state variable w is given by 

w = Aw 4- Bf 


where [see Eq. (13.69)] 
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This is the desired state equation for the state vector w. The solution of this equation 
requires a knowledge of the initial state w(0). This can be obtained from the given initial 
state x(0) by using Eq. (13.70b). I 


(7) Computer Example C13.4 

Solve Example 13.9 using MATLAB. 

A = [0 l;-2 -3]; B=[l; 2]; 

P=[l 1;1 -1]; 

Ahat=P*A*inv(P) 

Bhat=P*B © 


Invariance of Eigenvalues 

We have seen (Sec. 13.3) that the poles of all possible transfer functions of a 
system are the eigenvalues of the matrix A. If we transform a state vector from x 
to w, the variables wi, W 2 , . . . , w n are linear combinations of x\, X2, . . . , x n and 
therefore may be considered as outputs. Hence, the poles of the transfer functions 
relating w\, W 2 , ■ ■ ■ , w n to the various inputs must also be the eigenvalues of matrix 
A. On the other hand, the system is also specified by Eq. (13.68d). This means 
that the poles of the transfer functions must be the eigenvalues of A. Therefore, 
the eigenvalues of matrix A remain unchanged for the linear transformation of 
variables represented by Eq. (13.67), and the eigenvalues of matrix A and matrix 
A(A = PAP" 1 ) are identical, implying that the characteristic equations of A and 
A are also identical. This result also can be proved alternately as follows. 

Consider the matrix P(sl - A)P _1 . We have 

P(sl - A)P -1 = PsIP 1 - PAP 1 = sPIP- 1 - A = si - A 
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Taking the determinants of both sides, we obtain 

|P||sI - A||P _1 | = |sl - A| 

The determinants |P| and |P — 1 1 are reciprocals of each other. Hence 

|sl — A| = |sl — A| (13.71) 

This is the desired result. We have shown that the characteristic equations of A 
and A are identical. Hence the eigenvalues of A and A are identical. 

In Example 13.9, matrix A is given as 


A = 


0 1 

-2 -3 


The characteristic equation is 
l«I- A| = 

Also 


s —1 
2 s + 3 


= s 2 + 3s + 2 = 0 


A = 


-2 0 
3 -1 


and 


|sl - A| 


= s 2 + 3s + 2 = 0 


[s + 2 0 ' 

-3 s + 1. 

This result verifies that the characteristic equations of A and A are identical. 

13.4-1 Diagonalization of Matrix A 

For several reasons, it is desirable to make matrix A diagonal. If A is not 
diagonal, we can transform the state variables such that the resulting matrix A is 
diagonal.) One can show that for any diagonal matrix A, the diagonal elements 
of this matrix must necessarily be Ai, A 2 , . . . , A n (the eigenvalues) of the matrix. 
Consider the diagonal matrix A: 

ai 0 0 0 
0 <12 0 0 

A = ' 


0 0 0 a„ 


The characteristic equation is given by 

t In this discussion we assume distinct eigenvalues. If the eigenvalues are not distinct, we can 
reduce the matrix to a modified diagonalized (Jordan) form. 


1*1 -Ah 


(s - aj) 0 0 0 

0 (s - 02 ) 0 • - ■ 0 


(5 a n ) J 


= 0 


(s - ai)(s - a 2 ) ■ ■ ■ (s - a n ) = 0 

Hence, the eigenvalues of A are aj, a 2 , , a n . The nonzero (diagonal) elements 
of a diagonal matrix are therefore its eigenvalues A 1; A 2 , . . . , A„. We shall denote 
the diagonal matrix by a special symbol, A: 


A = 


Aj 0 0 

0 A 2 0 


(13.72) 


0 0 0 ••• A„. 

Let us now consider the transformation of the state vector A such that the resulting 
matrix A is a diagonal matrix A. 

Consider the system 

x = Ax + Bf 

We shall assume that Ai, A 2 , . . . , A„, the eigenvalues of A, are distinct (no repeated 
roots). Let us transform the state vector x into the new state vector z, using the 
transformation 

z = Px (13.73a) 


Then, after the development of Eq. (13.68c), we have 

z = PAP _1 z + PBf 


(13.73b) 


We desire the transformation to be such that PAP -1 is a diagonal matrix A given 
by Eq. (13.72), or 

z = Az + Bf (13.73c) 

Hence 

A = PAP -1 (13.74a) 

or 

AP = PA (13.74b) 

We know A and A. Equation (13.74b) therefore can be solved to determine P. 

B Example 13.10 

Find the diagonalized form of the state equation for the system in Example 13.9. 

In this case, 

0 r 


A = 


-2 -3 
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Fig. 13.8 Two realizations of the second-order system in Example 13.10. 


where 

Hence 

or 

21 ~ -2l + 4/ 

z 2 = -222 + 3/ (13.77b) 



Note the distinctive nature of these state equations. Each state equation involves only one 
variable and therefore can be solved by itself. A general state equation has the derivative of 
one state variable equal to a linear combination of all state variables. Such is not the case 
with the diagonalized matrix A. Each state variable Zi is chosen so that it is uncoupled 
from the rest of the variables; hence a system with n eigenvalues is split into n decoupled 
systems, each with an equation of the form 


Zi = Xi 2 i + (input terms) 
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This fact also can be readily seen from Fig. 13.8a, which is a realization of the system 
represented by Eq. (13.77). In contrast, consider the original state equations [see Eq 
13.70a)] 

il = 22 + f{t ) 
x 2 = — 2xi — 3x2 + 2 f(t) 

A realization for these equations is shown in Fig. 13.8b. It can be seen from Fig. 13.8a 
that the states zi and z 2 are decoupled, whereas the states xi and X 2 (Fig. 13.8b) are 
coupled. It should be remembered that Figs. 13.8a and 13.8b are simulations of the same 
system.) I 

O Computer Example C13.5 

Solve Example 13.10 using MATLAB. 

Caution: The answer for B is not unique. 

A— [0 l;-2 -3]; B=[l; 2]; 

[V, L]=eig(A); 

P=inv(V); 

Lambda=P*A*inv(P); 

Bhat=P*B © 


13.5 Controllability and Observability 

Consider a diagonalized state-space description of a system 

z = Az + Bf (13.78a) 

and 

Y = Cz + Df (13.78b) 

We shall assume that all n eigenvalues Aj, A 2 , ... , A n are distinct. The state 
equations (13.78a) are of the form 

z m — A m z m + b m ifi + b m 2 f 2 + • ' • + b m jfj m = 1, 2, . . . n 

If b m i, b m 2 , • • • , b m j (the mth row in matrix B) are all zero, then 

z m A m z m 

and the variable z m is uncontrollable because z m is not connected to any of the 
inputs. Moreover, z m is decoupled from all the remaining ( n — 1) state variables 
because of the diagonalized nature of the variables. Hence, there is no direct or 
indirect coupling of z m with any of the inputs, and the system is uncontrollable. In 
contrast, if at least one element in the mth row of B is nonzero, z m is coupled to 
at least one input and is therefore controllable. Thus, a system with a diagonalized 

fHere we only have a simulated state equation; the outputs are not shown. The outputs are 
linear combinations of state variables (and inputs). Hence, the output equation can be easily 
incorporated into these diagrams (see Fig. 13.7). 
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state [Eq s. (13.78)] is completely controllable if and only if the matrix B has no row 
of zero elements. 

The outputs [Eq.(13.78b)] are of the form 

3 

Vi Ci\Z\ -j- Ci2Z2 + ' • ■ + CijiZf, -f" ^ ' dimfm 

m= 1 

If Cim = 0, then the state z m will not appear in the expression for y t . Since all the 
states are decoupled because of the diagonalized nature of the equations, the state 
z m cannot be observed directly or indirectly (through other states) at the output 
Vi. Hence the mth mode e Xmt will not be observed at the output m- If cj m , c 2m , . . . 
. cfc m (the mth column in matrix C) are all zero, the state z m will not be observable 
at any of the k outputs, and the state z m is unobservable. In contrast, if at least 
one element in the mth column of C is nonzero, z m is observable at least at one 
output. Thus, a system with diagonalized equations of the form in Eq s. (13.78) is 
completely observable if and only if the matrix C has no column of zero elements. 
In the above discussion, we assumed distinct eigenvalues; for repeated eigenvalues, 
the modified criteria can be found in the literature. 1,2 

If the state-space description is not in diagonalized form, it may be converted 
into diagonalized form using the procedure in Example 13.10. It is also possible 
to test for controllability and observability even if the state-space description is in 
undiagonalized form. 1,2 ) 

I Example 13.11 

Investigate the controllability and observability of the systems in Figs. 13.9a and 
13.9b. 



r-1 1 

s+1 r-1 


Fig. 13.9 Systems for Example 13.11. 

fWe can show that a system is completely controllable if and only if the n x nj composite matrix 
[B, AB, A 2 B, . . . , A n-1 B] has a rank n. Similarly, a system is completely observable if and 
only if the n x nk composite matrix [C', A'C'. A' 2 C', . . . , A'”~ 1 C'] has a rank n. 
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The first column of C is zero. Hence the mode z\ (corresponding to Ai = 1) is unobservable. 
The system is therefore controllable but not observable. We come to the same conclusion 
by realizing the system with the state variables z\ and 22 , whose state equations are 

z = Az + B / 
y- Cz 

According to Eqs. (13.80) and (13.81), we have 

ii = zi + / 

Z 2 ~ ~Z2 + / 




(b) 


Fig. 13.10 Equivalent of the systems in Fig. 13.9. 

Figure 13.10a shows a realization of these equations. It is clear that each of the two modes 
is controllable, but the first mode (corresponding to A = 1) is not observable at the output. 
The state equations for the system in Fig. 13.9b are 


and 


Hence 


i 1 = ~x\ + / 

±2 = -2xi +x 2 + / 



(13.82) 
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ii = zi 
Z2 = -Z2 + / 

and thus 

y — zi 4- Z 2 (13.85) 

Figure 13.10b shows a realization of these equations. Clearly, each of the two modes is 
observable at the output, but the mode corresponding to Ai = 1 is not controllable. I 

Q Computer Example C13.6 

Solve Example 13.11 using MATLAB. 

A=[l 0;1 -1]; B=[l; 0]; C=[l -2]j 
[V, L]=eig(A); 

P=inv(V); 
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Ahat=P*A*inv(P); 
Bhat=P*B 
Chat=C*inv(P) Q 


13.5-1 Inadequacy of the Transfer Function Description of a System 

Example 13.11 demonstrates the inadequacy of the transfer function to describe 
an LTI system in general. The systems in Figs. 13.9a and 13.9b both have the same 
transfer function 

h( s ) = 4t 

Yet the two systems are very different. Their true nature is revealed in Figs. 13.10a 
and 13.10b, respectively. Both the systems are unstable, but their transfer function 
H (s) = does not give any hint of it. The system in Fig. 13.9a appears stable 
from the external terminals, but it is internally unstable. The system in Fig. 13.9b, 
on the other hand, will show instability at the external terminals, but its transfer 
function H (s) = is silent about it. The system in Fig. 13.9a is controllable but 
not observable, whereas the system in Fig. 13.9b is observable but not controllable. 

The transfer function description of a system looks at a system only from the 
input and output terminals. Consequently, the transfer description can specify only 
the part of the system which is coupled to the input and the output terminals. 
Figures 13.10a and 13.10b show that in both cases only a part of the system that 
has a transfer function H(s) = —j- is coupled to the input and the output terminals. 
This is the reason why both systems have the same transfer function H(s) — —. 

The state variable description (Eqs. 13.79 and 13.82), on the other hand, con- 
tains all the information about these systems to describe them completely. The 
reason is that the state variable description is an internal description, not the ex- 
ternal description obtained from the system behavior at external terminals. 

Mathematically, the reason the transfer function fails to describe these systems 
completely is the fact that their transfer function has a common factor s - 1 in 
the numerator and denominator; this common factor is canceled out with a conse- 
quent loss of the information about these systems. Such a situation occurs when 
a system is uncontrollable and/or unobservable. If a system is both controllable 
and observable (which is the case with most of the practical systems) the transfer 
function describes the system completely. In such a case the internal and external 
descriptions are equivalent. 


13.6 State-Space Analysis of Discrete-Time Systems 

We have shown that an nth-order differential equation can be expressed in 
terms of n first-order differential equations. In the following analogous procedure, 
we show that an nth-order difference equation can be expressed in terms of n first- 
order difference equations. 

Consider the z-transfer function 


b m z m + b m —iz m 1 + ■ - • + b\z + b o 
z n + a n -iz n ~ l + h a\z + do 


(13.86a) 
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Fig. 13.11 Controller canonical realization of an nth-order discrete-time system. 


The input /[fc] and the output y[fc] of this system are related by the difference 
equation 

(E n + a n -\E n 1 + • • ■ + a\E + ao)j/M = 

(b m E m + + • • • + biE + b 0 )f[k ] (13.86b) 

The controller canonical realization of this equation is illustrated in Fig. 13.11. 
Signals appearing at the outputs of n delay elements are denoted by xi[fc], Z 2 M 1 
. . . , x n [fc]. The input of the first delay is x n [k + 1]. We can now write n equations, 
one at the input of each delay: 


and 


Xl[fc + 1] = X2[fc] 
X2 [fc + 1 ] = X3 [fc] 


x n _i[fc + 1] = x n [fc] 

x n [k + 1] = -aoXi[fc] - aiX 2 \k] - ■ ■ ■ - a n -ix n [k ] + /[fc] 


(13.87) 


y(k) = b 0 xi(k) + bix 2 (k) H 1 ft m x m+1 (fc) (13.88) 


Equations (13.87) are n first-order difference equations in n variables xi(fc), x 2 {k), 
. . . , x n (fc). These variables should immediately be recognized as state variables, 
since the specification of the initial values of these variables in Fig. 13.11 will 
uniquely determine the response y [fc] for a given /[fc]. Thus, Eqs. (13.87) repre- 
sent the state equations, and Eq. (13.88) is the output equation. In matrix form we 
can write these equations as 
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x[fc] = A 2 x[fc - 2] + ABf \k - 2] + Bfffc - 1] 
Substituting Eq. (13.92c) in this equation, we obtain 


I Example 13.12 

Give a state-space description of the system in Fig. 13.12. Find the output y[k ] if the 
input f[k] = u[fc] and the initial conditions are £i[0] = 2 and x 2 [0] = 3. 

The state equations are [see Eq. (13.89)] 


x[fc] = A 3 x[Jfe - 3] + A 2 Bf[fc - 3] + ABfjfc - 2] + Bf [k - 1] 

Continuing in this way, we obtain 

x[fc] = A*x[0] + A fc_1 Bf[0] + A* -2 Bf[l] H h Bf[fc - 1] 

fc -1 

= A*x[0] + A fe - 1-J Bf[j] (13.93a) 

j = o 


and 


£l[fc + 1] 


x 2 [fc + 1] 



»[*] = [- 



Xl[fc] 

+ 

O' 


x 2 [k] 


1 


£l[fc] 




x 2 [fc] 




(13.96a) 


(13.96b) 


To find the solution [Eq. (13.94)], we must first determine A*. The characteristic equation 
of A is 


The upper limit on the summation in Eq. (13.93a) is nonnegative. Hence k > 1, 
and the summation is recognized as the convolution sum 


]AI-A| 




(‘-i)(*-D- 


Hence 


and 


A fc - 1 ti[fc - 1] * Bf [k] 

x[fc) = A*x[0] + A*- 1 u[fc-l]«Bf[fc] (13.93b) 

zero-input zero-state 

y [k] = Cx + Df 

fc-i 

= CA*x[0] + CA fc-1- ^Bf[j] + Df (13.94a) 

3=0 

= CA l x[0] + CA fc - 1 u[Jt - 1] * Bf[fc] + Df (13.94b) 


In Sec. B.6-5, we showed that 

A* = 0 o l + /8iA + /? 2 A 2 + • • • + /?n— l A n— 1 
where (assuming n distinct eigenvalues of A) 


00 ' 


1 Ai A? ••• A" -1 

-1 

'Af 

01 

= 

1 A 2 \\ ‘ * ^2 



fin— 1 . 


.1 A n A 2 ••• A"" 1 . 


A. 


(13.95a) 


(13.95b) 


and Ai, A 2 , . . . , A n are the n eigenvalues of A. 

We can also determine A k from the z-transform formula, which will be derived 
later in Eq. (13.102): 


A* = Z- 1 [(l-z~ l A)- 


(13.95c) 


Hence, Ai = | and A 2 = | are the eigenvalues of A and [see Eq. (13.95)] 


where [see Eq. (B.95b)] 


A k = 0 o l + 0iA 


'0o' 


1 V 

-1 



' 3 -2' 

'( 3 )"*' 


' 3(3)"* -2(2)"* ' 

01. 


.1 5. 


,(§)\ 


-6 6 

.(2 r*. 


-6(3)-* + 6(2)-* 


A k = [3(3)- fc - 2(2)- fe ] 

3(3)~* — 2(2) —fc 
. (3)- fc - ( 2 r k 


0 
1 

-6(3)-* + 6(2)"* 1 


[-6(3)-* + 6(2)-*] 


0 



1 



(13.97) 


We can now determine the state vector x[fc] from Eq. (13.93b). Since we are interested in 
the output y[fc], we shall use Eq. (13.94b) directly. Note that 

CA* = [ — 1 5] A* = [2(3) - * — 3(2)“* -4(3)“* + 9(2)“* ] (13.98) 

and the zero-input response is CA*x[0], with 


x[0] = 


2 

3 


Hence, the zero-input response is 

CA fc x[0] = _8(3)“* + 2l(2)~ k (13.99a) 

The zero-state component is given by the convolution sum of CA fc-1 u[fc — 1] and 
Using the shifting property of the convolution sum [Eq. (9.46)], we can obtain the zero- 
state component by finding the convolution sum of CA fc u[jt] and Bf[Ar] and then replacing 
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Fig. 13.12 System for Example 13.12. 


k with k — 1 in the result. We use this procedure because the convolution sums are listed 
in Table 9.1 for functions of the type f[k]u[k] rather than f[k\u[k — 1]. 


CA*u[/b] * B f[k\ = [2(3)" fe - 3(2)“* -4(3)" fc + 9(2)"* ] * 



= —4(3) k * u[k] + 9(2) k * u[fc] 


Using Table 9.1 (Pair 2a), we obtain 


ri_ 3 -(fc+in ri - 2 _(fc+1) l 

CA fc u[fc] * B f[k] = -4 — 1 u[fc] -|- 9 — 1 u[k] 

1 “ 3 1 “ 2 

= [12 + 6(3 _<fc+1) ) - 18(2' ( ' !+1) )]u[*:] 

Now the desired (zero-state) response is obtained by replacing k by k - 1. Hence 

CA‘«[1] * B f[k - 1] = [12 + 6(3)-'' - 18(2)-'=]u[fc - 1] (13.99b) 

It follows that 

y[fc] = [-8(3)-* + 21(2)-''u[fc] + [12 + 6(3)-* - 18(2)“ fc ]«[fc - 1] (13.100a) 

This is the desired answer. We can simplify this answer by observing that 12 + 6(3)~* - 
18(2)“' c = 0 for k — 0. Hence, u[k - 1] may be replaced by u[fc] in Eq. (13.99b), and 

y[k] = [12 - 2(3) -k + 3(2)- fc M*:] (13.100b) 


(T ) Computer Example C13.7 

Solve Example 13.12 using MATLAB. 

A=[0 l;-l/6 5/6]; B=[0; 1]; C=[-l 5]; D=0; 

x0=[2;3]; 

k=0:25; 

u=ones(l,26); 

[y,x]=dlsim(A,B,C,D,u,xO); 
stem(k,y) © 
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© Computer Example C13.8 

Using MATLAB find the zero-state response of the system in Example 13.12. 

A=[0 1 ;-l/6 5/6]; B=[0; 1]; C=[-l 5]; D=0; 

[num,den]=ss2tf(A,B,C,D); 

k=0:25; 

u=ones(l:length(k)); 
y=filter(num,den,u); 
stem(k,y) © 

13.6-2 The 2-Transform Solution 

The z-transform of Eq. (13.91) is given by 

zX[z] - zx[0] = AX[z] + BF[z] 

Therefore 

(zl - A)X[z]) = zx[0] + BF[z] 

and 

X[z] = (zl - A) -1 zx[0] + (zl - A) _1 BF[z] 

= (I - ar -1 A) -1 x[0] + (zl - A) -1 BF[z] (13.101a) 

Hence 

X[fe] = Z-'Kl - z^A)" 1 ^] -h-Z^zI - A) _, BF[z]] (13.101b) 

V ' 1 y " y ^ 

zero-input component zero-state component 

A comparison of Eq. (13.101b) with Eq. (13.93b) shows that 

A fe = - z -1 A) _1 ] (13.102) 

The output equation is given by 

Y[z] = CX[z] + DF[z] 

= C[(I - *- 1 A)- 1 x[0] + (zl - A) -1 BF[z]] + DF[z] 

= C(I - z _1 A) _1 x[0] + [C(zl - A) -1 B + D]F[z] (13.103a) 

= C(I — z~^A)- 1 x[0] + H[z]F[z] 

zero-input response zero-state response 

where 

H[z] = C(zl - A _1 )B + D (13.103b) 

Note that H[z] is the transfer function matrix of the system, and /fy[z], the ij th 
element of H[z], is the transfer function relating the output yt(k) to the input fj{k). 
If we define h[k] as 


h[fc] = 2- 1 [H[z]] 
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then h[fc j represents the unit impulse function response matrix of the system. Thus, 
the ij th element of h (k), represents the zero-state response yi(k) when the 
input fj(k) = A [fc] and all other inputs are zero. 

■ Example 13.13 

Using the 2 -transform, find the response y[k] for the system in Example 13.12. 
According to Eq. (13.103a) 



Linear Transformation, Controllability, and Observability 

The procedure for linear transformation is parallel to that in the continuous- 
time case (Sec. 13.4). If w is the transformed-state vector given by 

w = Px 

then 

w[fe + 1] = PAP _1 w[fc] + PBf 

and 

y[fc] = (CP -1 )w + Df 

Controllability and observability may be investigated by diagonalizing the matrix. 


13.7 Summary 

An nth-order system can be described in terms of n key variables — the state 
variables of the system. The state variables are not unique, but can be selected 
in a variety of ways. Every possible system output can be expressed as a linear 
combination of the state variables and the inputs. Therefore the state variables 
describe the entire system, not merely the relationship between certain input(s) and 
output(s). For this reason, the state variable description is an internal description 
of the system. Such a description is therefore the most general system description, 
and it contains the information of the external descriptions, such as the impulse 
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response and the transfer function. State-variable description can also be extended 
to time-varying parameter systems and nonlinear systems. An external system 
description may not describe a system completely. 

The state equations of a system can be written directly from the knowledge 
of the system structure, from the system equations, or from the block diagram 
representation of the system. State equations consist of a set of n first-order differ- 
ential equations and can be solved by time-domain or frequency-domain (transform) 
methods. Because a set of state variables is not unique, we can have a variety of 
state-space descriptions of the same system. It is possible to transform one given 
set of state variables into another by a linear transformation. Using such a trans- 
formation, we can see clearly which of the system states are controllable and which 
are observable. 
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Problems 

13.1-1 Convert each of the following second-order differential equations into a set of two 
first-order differential equations (state equations). State which of the sets represent 
nonlinear equations. 

(a) y + lOy + 2y = / 

(b) ji + 2e > t/ + logy = / 

(c) y + 4>i(y)y + <t>i(y)y = f 

1/2 F 



Pig. P13.2-1 


13.2- 1 Write the state equations for the RLC network in Fig. P13.2-1. 

13.2- 2 Write the state and output equations for the network in Fig. P13.2-2. 

13.2- 3 Write the state and output equations for the network in Fig. P13.2-3. 

13.2- 4 Write the state and output equations for the electrical network in Fig. P13.2-4. 

13.2- 5 Write the state and output equations for the network in Fig. P13.2-5. 
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Fig. P13.2-5 


Fig. P13.2-6 


13.2- 6 Write the state and output equations of the system shown in Fig. P13.2-6. 

13.2- 7 Write the state and output equations of the system shown in Fig. P13.2-7. 

13.2- 8 Write the different sets of state equations (two canonical, series, and parallel forms) 

and the output equation for a system having a transfer function 


13.2-8 Repeat Problem 13.2-8 if 


H(s) 


3s+ 10 
s 2 + 7s + 12 


(a) H(s) 


4s 

(s+l)(s + 2) 2 


(b) H(s) 


s 3 + 7 s 2 + 12s 
(s + l) 3 (s + 2) 


13.3-1 Find the state vector x(t) using the Laplace transform method if 


x = Ax + Bf 
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13 State-Space Analysis 


13 . 3-6 


13 . 3-7 


13 . 3 - 8 

13 . 3 - 9 
13 . 3-10 


13 . 3 - 11 

13 . 3 - 12 

13 . 3 - 13 

13 . 3 - 14 

13 . 3 - 15 

13 . 3 - 16 

13 . 3 - 17 

13 . 3 - 18 

13 . 3 - 19 
13 . 4-1 


Repeat Prob. 13.3-5 if 



C = [ 1 1] D = 1 


f(t) = «*(t) x(0) = 

The transfer function H(s) in Prob. 13.2-8 is realized as a cascade of H\(s) followed 
by # 2 ( 5 ), where 

rr/ , 1 , rr / , 3S + 10 

Hl{s) = 7 ^ and " 2(s)= TTT 

Let the outputs of these subsystems be state variables xi and X 2 , respectively. Write 
the state equations and the output equation for this system and verify that H(s) = 
C^(s)B + D. 

Find the transfer-function matrix H(s) for the system in Prob. 13.3-5. 

Find the transfer-function matrix H(s) for the system in Prob. 13.3-6. 

Find the transfer-function matrix H(s) for the system 

x = Ax + Bf 



y = Cx + Df 

where 

'0 1] [0 1 /i(t) 

A = B = f = 

-1 -2 J [l Oj [ h(t ). 

"1 2 ] [0 0 

C = 4 1 D = 0 0 

.1 lJ Ll 0 

Repeat Prob. 13.3-1, using the time-domain method. 

Repeat Prob. 13.3-2, using the time-domain method. 

Repeat Prob. 13.3-3, using the time-domain method. 

Repeat Prob. 13.3-4, using the time-domain method. 

Repeat Prob. 13.3-5, using the time-domain method. 

Repeat Prob. 13.3-6, using the time-domain method. 

Find the unit impulse response matrix h(t) for the system in Prob. 13.3-7, using Eq. 
(13.65). 

Find the unit impulse response matrix h(f) for the system in Prob. 13.3-6. 

Find the unit impulse response matrix h(t) for the system in Prob. 13.3-10. 

The state equations of a certain system are given as 


XI — X2 + 2/ 

X2 = —X\ — X2 + / 
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Fig. P13.5-1 


13.5- 1 Write the state equations for the systems depicted in Fig. P13.5-1. Determine a new 

state vector w such that the resulting state equations are in diagonalized form. Write 
the output y in terms of w. Determine in each case whether the system is controllable 
and observable. 

13.6- 1 An LTI discrete- time system is specified by 


and 


'2 O' 


'O' 


B = 


1 1 


1 


and D = [1] 


x(0) = 



and f[k] = u[fc] 


(a) Find the output y\k], using the time-domain method. 

(b) Find the output y[fc], using the frequency-domain method. 

13.6-2 An LTI discrete-time system is specified by the difference equation 


y[k + 2] + y[k + 1] + 0.16y[fc] = f[k + 1] + 0.32/[fc] 


(a) Show the two canonical, series and parallel realizations of this system. 

(b) Write the state and the output equations from these realizations, using the 
output of each delay element as a state variable. 

13.6-3 Repeat Problem 13.6-1 if 


y[k + 2] + y[k + 1] - 6y[fc] = 2/[fc + 2] + /[*: + 1] 
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Ziemer, R.E., W.H. Tranter, and D.R. Fannin, Signals and Systems, Macmillan, 
New York, 1983. 


Answers to Selected Problems 


Chapter 1 

1.1- 1 (a), (b), and (c) rr (d) 4 tt 1.1-4 P f = P_ f = 64/7, P 2f = 256/7, P cf = 64c 2 /7 

1.1- 6 (a) 50 (b) 178 (c) 51 (d) 25 (e) 25 (f) 1/2. 

1.4- 2 Aft) = (4t+l)u(t+l)-6tu(t)+3u(t)+(2t-4)u(t-2), / 2 (t) = t 2 u (t)-(t 2 -2t+8)u(t-2)-(2t-8)u(t-4) 

1.4- 4 (a) 0 (b) |4(w) (c) A iff) (d) -A«(t - 1) (e) yAjSfw + 3) (f) kS(u) 

1.4- 5 (a), (b) f(t) (c) 1 (d) 0 (e) 20.085 (f) 5 (g) /(- 1) (h) -7.389 

1.4- 11 (a) ±j3 (b) -3±j3 (c)2±j3 (d) -2 (e) 2 (f) 0. 

i Only (b), (f) and (h) are linear 1.7-2 Only (a) and (f) are time-invariant. 

1.7- 3 y(t) = [e-P+N + 2 (t + 5) e -(‘+ 3 > + 2] u(t + 5) - [e~(«- 5 ) + 2(t - 5) e -(‘- 5 > + 2] u(t - 5) 

1.7- 7 (a) Causal (b) Noncausal (c) Noncausal (d) Noncausal. 

1.8- 1 (D + 3)m (t) = /ft), (D + 3) V2 (t) = Df(t) 1.8-3 q 0 (t) = ( D + a)h(t) = A gj (t) 

Chapter 2 

2.2- 1 (a) A 2 + 5A + 6, A 2 + 5A + 6 = 0, -2, -3, and e~ 2t , e~ 3t (b) 5e- 2t - 3e“ 31 

2.3- 2 S(t) + (e -2 * + e- 3, )u(t) 2.3-4 (2 + 3 t)e~ 3t u(t) 

2.4- 5 (a) tuft) (b) (c)|t 2 u(t) 2.4-6 (a) (1 - cost)u(f) (b) sin tuft) 

2.4- 8 (a) (I _ | e - 3 ‘ + i e - 2 ‘)u(t) (b) (e~ 2t - e~ 3 ‘)u(t) fc) [(2 - t)e~ 2< - 2e- 3 ‘]u(t) 

2.4- 10 (a) [0.555 -e- 2, cos(3t + 123.7° )Ju(t) (b) 4[e-* - -A= e - 2 * cos(3t + 71.56°))u(f) 

2.4- 11 (a) ( e~‘ - e~ 2t )u(t) (b) e«( e" 1 - e- 2t )u(f) (c) e- 6 [ e -('- 3 > - e - 2 (‘- 3 >]uft - 3) 

(d) (1 - e~‘)u(t ) - [1 - e-P-Pjuft - 1) 2.4-13 tan -1 1 + f 

2.4- 15 1 - cost for 0 < t < 2w, cost - 1 for 2?r < t < 4rr, 0 otherwise. 2.4-21 H(s) = e~ ,T . 

2.5- 1 (a) I e - 3 * - Ae- 41 + A (b) A e - 3 < - | e - 4 < + A e -t (c) e -3t _ e -4t 

2.5- 3 (a) (n + M t ) e -2«_ 2e -3< (b) (| + ^ t)e -2« 2.5-4 2-A e - 2 « + A t 3.5.5 (2 _ t)e -3«_ 2e -4 t 

2.6- 2 (a) Asympt. stable (b) marginally stable (c) unstable fd) marginally stable. 

2.6- 3 (a) 0 (b) marginally stable (c) BIBO unstable 2.7-1 (a) No (b) Yes 

2.7- 2 Width 0.6 ms, maximum rate 1667 pulses/sec. 2.7-3 (a) 10~ 4 fb) 10 4 Hz (c) 10 4 pulses/sec. 

Chapter 3 

3.1-2 (a) c = 0.5 (b) E e — 1/12 3.2-1 Cn, = c„ 3 = 0, c„ 2 = -1, c, 4 = V2/tr 

3.4- 1 (a) /ft) = A + iz-ljL cosn7rt 

3.4- 3 (a) u, 0 = tt/2, uo = 0, f>„ = 0 and a„ = ^ sin(n7r/2) (c) w 0 = 1, o 0 = 0.5, o„ = 0 and ft„ = - JL 

(f) w 0 = 7r/3 , o 0 = 0.5, b„ = 0 and a„ = -^-jfcosfmr) _ C os(2ni) 

3.4- 4 (a) w 0 = 2, ao = 0.504, a n = 0.504(y ^ f. n5 ) and 6„ = -0.504( ) 

3.4- 7 (a) wo = rr/4, a 0 = 0, a n = sin - 1) and b n = sin ^ 

3.4- 9 All except (c) and (e) are periodic. Periods (a) 2rr (b) 2tr (d) 2 (f) 140tr (g) 8tr/3 fh) 2tr (i) rr. 

3.4- 11 /(t)^ixo(t)-ix 1 (t)-A X3 ( t )_i X7(t) 3.4-12 /ft) = -ft + I Ut 3 - ft) + - . - 
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Answers to Selected problems 


3.5- 1 

3.5- 5 

4.1- 5 

4.1- 6 

4.3- 2 

4.3- 3 

4.3- 6 

4.3- 7 

4.4- 3 

4.5- 1 

4.6- 5 

4.7- 5 

4.8- 4 

5.1- 2 

5.1- 4 

5.1- 6 

5.1- 8 

5.1- 9 

5.2- 3 

6 . 1-1 

6 . 1-2 

6.1- 3 

6 . 2 - 1 

6.2- 3 

6.2- 4 

6.3- 1 

6.3- 2 

6.3- 3 

6.3- 4 

6.3- 5 

6.3- 7 


(b) w 0 = 1/5, D n = JL sin(n7r/5) (d) w 0 = 2, D 0 = 0, D n = -£(£ sin(^) - cos(^) 
(e) wo = 2 tt/3, Do = 1/6, and D„ = [ e -j 2 W3(i2p + 1) - 1] 

AT = 3 3.5-6 N = 6 3.5-7 N = 2 3.6-1 y(t) = ^ 


4-2e~J a, -2e~J 2w 


Chapter 4 

(b) — (cos (Jr + wt sin o/r — 1) 


(a) K‘ -2)smu,0t+2u, 0 tcos^0t ( b ) *Bi±j ! SZt 4 . 2 -4 (a) ^sinc[wo(t-to)] (b) 

F 2 (ul) = 2 .-^(cosyinw- 1 ) | FsW = 

(a) ^sin 2 (^) (b) ( c ) ( d ) X ~‘ 4 ' 3 " 5 j'4sinc(w)sin 3w 

(a) ^ | sine 2 j + s i nc 2 j' »(^+ 10 ) j ) (c) 7r[sincir(w + 10) + sinc7r(w — 10)]e _j2lT ^ 

(a) ^sinc (£) cos 4£ 4.4-1 (a) (e -t — e~ 2t )u(£) (c) ^e -t u(£) + £) (d) (1 — e _t )u(£) 

(d) Bandwidths of y \ (£), y2(£) and y(£) are 10 kHz, 5 kHz, and 15 kHz, respectively, 
to — 3\/2 k 4.5-2 £o — 40 fis 4.5-3 All unrealizable, (a) £4 = 1 /xsec. (b) £<* « 100 use c. 

B = 0-366 Hz. 4.7-2 (a) Yes (c) minimum u> c = 27 rS (d)No (e) Works only for even n. 

(a) A = 20, (b) A - 10, (c) A = 5 4.8-3 £ F M = 42 kHz, B PM = 38.06366 kHz. 

AJT= 100 Hz, B= 2.2 kHz 4.8-5 AT = 20 kHz, B= 42 kHz. 

Chapter 5 

(a), (b) 200 Hz (c) 120 Hz (d) 150 Hz 5.1-3 The signal recoverable only in cases (b) and (c). 
(a) h(t) = u(£) - u(t — 1) 5.1-5 (b) H(u) — Tsinc 2 (^) (c) Minimum delay= T 

F(u) = 0.2F(w) + I ZZ -00 sinc (¥ ) F (“ - 5 °°*)- 
(a) 30 kHz (b) 16 bits (c) 480,000 bits/s (d) 705,600 bits/s 
(a) 10.8 MHz (b) 10 bits (c) 108 Mbits/s 5.2-1 No = 512, zero padding required. 

N 0 = 256, T = 0.03125 by both criteria. 5.2-4 (a) No = 16, T = 0.625 (b) N 0 = 8, T = 1.25 

Chapter 6 

( a ) i( 1 ~ e ’) ( C ) ( s i+„ 0 °i)2 ( e ) §[a 2 + (u>i+w 2 ) 2 + 3 3 +(wi-w 2 ) 2 1 a 2 -a 2 ^ a 2 +4a+29 

(a) ^-(1 — e“ s — se~ s ) (b) i±^ZZL ( c ) -1^(1 - e -^ 3e -.) + ^-(.+1) 

(b) 3.018e -2t cos(3t+6.34°)u(t) (c) 6(t) + (3.2e 3! -0.2e~ 2 ‘)u(t) (g) [e-*-(l+t+4 + £)e- 2t ]u(t) 

(h) “ j(! - 2t)e _2< + *pe _2t cos(t + 71.56°)]u(t) 


4.2-4 (a) ^sinc[wo(t - to)] (b) 


(c)£r (d) x J t c-<-+ 1 > t (e)i±^fe-(*+ 1 )- (g) cos HSLL 

(b) V2e _ ( t_3 ) cos(t — 3+ ^)u(t — 3) + 2e -t sintu(t) (c) [|e( ,-1 l sin2(t — l)]u(t - 1) + |e‘sin2tu(t) 

(b) *(*=££) 

(a) (e“ ! -e- 2i )u(t) (b) (2 + 6t)e" 2t u(t) (c) 2 + 5.836e- 3 ‘ cos(4t - 99.86°)u(t) 

The zi & zs comps, are: (b) (2+5t)e -24 , te -2t (c) v^e -31 cos(4t — ]j), 2+5. 154e~ 3t cos(4t- 112.83°) 
(a) 1/1 (t) = (5 - je - ' - |e _4t )u(t), y 2 (t) = (j - 56“* + ^e- 4 *)u(t) 
yi(t) = [(8 + 17.89- l - 5i cos(i - 26.56°)]u(t), y 2 (t) = 20\/2e“ 1 5 * cos(| - f)u(t) 

(a) 6 ' 3 ' 6 (a) (D 2 + 3D + 8)y(t) = (D + 5)/(t) 

(iii) (1.5e -2 t*~' 5 l — 2e -3 l*“ 5 l + 0.5e -4 l 4-5 l)u(t — 5) (iv) e 20 (1.5e -2t — 2e -3t + 0.5e -4t )u(t) 

(v) e -20 (1.5e -2 ( t-5 ) — 2e~ 3 ^ -5 ) + 0.5e -4 ^ -3 ^)u(t — 5) 
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6.3- 9 TO [ e_t + 4 S cos(3t-161.56°)j u(t) 6.4-1 (t e - 1 - le~* sin t)u(t) 6.4-2 (5 - ^e~ 2t / 3 )u(t) 

6 - 4-3 W TZ^ 6 ^) (*>) 2^“W G.4-4 yi(t) = (4- |e“‘ - ±e~ 3t )u(t) y 2 (t) = (2- f e~* + le- 3 ‘)u(t) 

6.4- 5 yi(t) = 7.787e-‘/ 6 cosf^pt - 31.1°)u(t), u,(t) = f «(t) + (10 + 9.045 e -‘/ 6 cos(^t - 152.2°)u(t) 

6.4- 6 40e- f / 5 u(t) 6.4-7 1.716e- 2 ‘ cos(3t + 29°)u(t) 6.4-8 (121.61 e - 6 - 53t - 1.61e _2 - 8 ‘)u(t) 

6.7- lb PO ~ 3%, £ r = 1.15 secs., t s — 2.67 secs., e 8 = 0, e r — 0.75, e p — oo. 

6.7- 2 K\ = 2, K 2 = 25.4, a = 6.128 6.7-3 t 3 cannot be satisfied. 6.7-5 No. 

6.8- 1 (a) No region of convergence (b) — 1 < Re s < 0 (c) Re s = 0 (d) — 1 < Re s < 0 (e) all s 

6.8- 2 (a) |Res| < 1 (c) p ^_ 2) 1 < Res < 2 (f) 0<Res<l 

6.8- 3 (b) e 2t u(t)-e 3t u(— £) (c) (e -t +e" 2t )u(£) (d) — (e~ l +e~ 2t )u(—t) (e) (e -t -fe _3t )«(£)— e 5t u(—£) 

6.8- 4 (a) (e“* — e l + 2e“ 2 *)u(£) (b) (— e~ l + e l — 2e _2t )u(— £) 

(c) (e _t + 2e“ 2t )u(£) + e*^— £) (d) 2e~ 2t u(£) + (— e -t + e t )u(— £) 

6.8- 5 (a) [— |e -t + 2e -t / 2 ]u(£) -f |e t / 2 u(-£) (d) ([^e -t 4- \e 2t ]u{t) + |e t u(— £) (f) infinite 

Chapter 7 


7.1- 1 (a) \/2 cos(2£ — 15°) (b) 2 n/ 2 sin 2 £ (c) 2.28 cos(3£ - 12.12°) 

7.1- 2 (a) 7.5 u(t) (b) ^ cos(2t + 3.69 0 )u(t) (b) ^3 sin(3t - 112.62°)u(t) (c) ^ff^ 3t - 67 - 62 °'>u(t) 


7.5-1 H(s) .3 +2 00s 2 +20.000.+10 6 


7.5-3 H(s) ■■ 


1.002 x 10^° 

s 4 +2.615x 10 5 s 3 +3.418x 10 10 s 2 +2.618x 10 5 s41.002x 10 21 


7 6-2 H(<t } = 4.9x10° 7 7 1 Ff(e\ 

' ' s 3 +98.8. 2 + 12380. +491,300 n \ s ) »S+52.4. 4 +1375. 3 +22,284a 2 +223,19 2 .+r, 117,708 

7 7-2 H/.l — a 3 7 7 3 pf{a\ — 2.255 xlO 4 a 2 

' ' ' a 3 +59.05a 2 +942. 81a+ 19,079.42 ' 1 a4+212.4» 3 +72,550a 2 +5.31 X 10 6 a+6.25x 10 1 

7 7-4 — 2.24xl0 4 a 2 7 7 K t//-l _ (» z + 1200) 2 

- ^ V 3 / .IrlH 7a ;i +74 S17a 2 4 ! I 7 V 1 ll', . 1 C 25 x 1 * ’ 1 ** \ S ) ~~ .Ij-IK U.lrlQO S,Ufi7 


a 3 +59.05a 2 +942. 81a+ 19,079.42 “ 

2.24xl0 4 a 2 

s 4 + 164. 7a 3 +74, 817a^4. 117 XlO 4 a+6. 25 XlO 4 


If o\ — 2.255 XlO 4 a 2 

w a 4 +212.4a 3 +72,550a 2 +5.31 X 10«a+6.25x 10 s 

rr rj K ff ( (a Z + 1200) 2 

w _ a 4 +56. 53a 3 +399. 85^+67,8245 + 1.44 XlO 4 


Chapter 8 

8.2- 2 (a), (b)(-i)* (c)(-e)* (d) {-e) k 8.2-3 Aperiodic: (b) & (c); Periodic: (a) N 0 = 4 & (d) No = 6. 

8.2- 4 (c) Periodic; No = 20 . 8.2-5 12/ and |f2/| are (b) -0.8ir, 0.8ir (c) 0.6168, 0.6168 (e) 0.9ir, 0.97T 

8.2- 7 (a) e’<°- 2,,k+e > (b) e’ ok = 1 (c) e i 4 333k (d) e ii- 3 '* 8.2-8 (a) and (b) 2.7778 (c) 2.7778c 2 

8.2- 9 (a) 19 (b) 19 (c) 252 (d) 40 8.2-10 (a) 1 (b) 1 (c) 0.5 (d) 0.5 (e) 0.5 8.2-11 (a) f (b) | 

8.3- 2 10cos(0.9irfc— |) and 5cos(0.97rfc— f) 8.3-3 lOcos (ffc) + VlOcos - 1.107) 

8.3- 4 (i)1500 Hz (ii) 1500 Hz (iii) dc (iv) 1500 Hz (v) 2000 Hz. (vi) 600 Hz 

8.4- 4 (a) /{k] = (k + 3) (u[k + 3] — u[fc]) + (— fc + 3) (u[fc] — u[k — 4]) 8.5-2 p[fc + 1] — 1.02p[fc] = 1.01i[fc] 


Chapter 9 


9.1- 4 -12,36 and -63 9.1-5 -5,7.667, and -5.445 

9.2- 2 -(3 + 2k)(-l) fc 9.2-3 2(y/2) k cos(f k) 9.2-4 [2 w (0.5) fc - (0.5) JV (2) t ] 

9.3- 1 0.55[fc] - 0.5(— 2)*u[fc] 9.3-4 2.061(5) fc cos(0.923fc - 0.244)u[fc] 

9.3- 5 (b) 35[fc] - 56 [k - 1] - 26[k - 3] 

9.4- 1 ^[e-ffc+D - (-2)*+ 1 ]u[fc] 9.4-3 9[^-(3)' t + 1 - (2) fc+I - | (— 5) fc + 1 ]u[k] 

9.4- 4 |f[(3)- fc — (2) fc + 5k(2) fc ]u[k] 9.4-5 ^((S)^ 1 cos[f(k + 1) - 2.261] + 0.637(2)' i + 1 )u(k] 

9.4- 7 (a) §[(2) fc+1 - (0.5) fc+1 Hk] (b) ^[(2) fc + 1 - (0.5) fc+1 ]u[k] (c) |[(2 fc - 1 - (0.5) fc -‘]u[k - 2] 
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9.4- 8 50000[(1.01) fc+1 - l]u[fc] - 1500(1. 01) fc “ 4 u[fc - 4] 9.4-10 N = 23, residual pmt $471.2 

9.5- 1 2eVi l 2e ( — 2 ) fc + e ~ k ] 9.5-2 ^[-(-2)* + e~ k ] 9.5-3 (b) §±(-1)1 - f (-2) fe + 21(3)* 

9.5- 4 (2| Jfc)(_i)fc _ ^(3)-* g.5-6 0.241(0.2)1 - 0.377(0.8)* + 0.765 cos(^ - 1.393) 

9.6- 1 (a) Asympt. stable (b) marginally stable (c) unstable (d) unstable (e) marginally stable. 

Chapter 10 

10.1- 1 2ei°- 4wk + e 3{0.8irk+Tr/2) _j_ e j(1.2irk-ir/2) + 2e jl.6nk 

10.1- 2 I[ e J'0.5irfc e j0.9irk gjl.lirfc e jl.5irfcj 10.1-3 e j(0.87rfc+1.67r) _j_ ^j{\.2-nk-l.e-K) 

10.1- 4 Qq = 7r/3, Nq — 6, D r — g[3 + 4cos(§r) + 2cos(~ t r)j 


(a) 1 (b) e-i nfc o ( C ) -jfc- (d) 10 . 2 -2 (b) e -i3«[ 3 + 4cosQ-f-2cos2Q] 

Isinc=(^) 10.3-1 (a) 10.3-2 (a) (b) 

(a) /[*] = ±sinc 2 (^) (b)F 13 fc |(n) = i£ n A(^),F [4fc) (0) = l/4 (c) ft (ft) = 2A(2B). 

[2(— 0.5) fc - §(-0.8) fc + §(-0.2)i]u[Jt] 10.5-3 [-(0.5)1 + §(0.8)*]«[fc] + §(2)i«[-(fc + 1)] 

The 3-point DFT is Fi = 8, F 2 = e 2 f , F 3 = e~> i . F(U) = 3e j0 + 3 + 2e-J' n . (c) The 8-point DFT 
is 8, 6.5355 + j0.707, 3 + j, -0.5355 +j0.707, -2, -0.5355 - j0.707, 3 - j, 6.5355 - j0.707. 

The 1-point DFT is Fo = 1 and F(Q) = 1 (c) The M)-point DFT is 1, 1, , • - • , 1, 1. 

(a) The JVo-point DFT is No, 0, 0, 0, ■ • ■ , 0, 0, F(fi) = ‘vX.p - 

(a) The 5-point response is 9, 12, 16, 8 3. (b) The Periodic Convolution is 17, 15, 16. 

The &-point response is 3, 8, 14, 9, 5, 3 10.6-9 The output y[k] is 1, —1, 1, 3, -1, 1, 

Chapter 11 


(b) -§«[*] + [(2)1 - ±(3)‘]u[k] (d) [§- 7(2)1 + §(3)l]«[fc] (e) [3(_l)l_ 3(2)1 + 2fc(2)l]u[fc] 
0) [(2)l + v^(5)lcos(f -^)] U [fc] (k) [1- 3(2)1 _Ifc(2)* + I*(k-l)(2)l] u [k] 

, 1 HOP z 8 -2z 4 + l .. z 6 +2z 5 +3z 4 +4z 3 +3z 2 +2z + l 


2,-1, and 4 11.2-2 

(a) (b) + 

f I J- _ 4 (A\~k 


r» z*-2z 4 + l __ z°+2z f> +3z , +4z ,> +3z*+2z+l 
1 z’(z-l ) 2 ° f T7 

T^ 1 (c) FjHfri W 


[§ + §(2)-l - §(4)-l]ti[k] 11.3-4 [f - §(4)-l - f (2)-*M*l 

[0.318(e)! - 0.367(\/2)i cos (§f k - 0.525)]u[fc] 11.3-9 [1.32(e)! - 0.186(-0.2)l - 1.13(0.8)l]u[fc] 

(a) 12[4-i + 3(2)“l - 4(3)-l]«[k] (b) 12(4-<i- 2 > + 3(2)-<l- 2 > - 4(3)-(i- 2 ’]u[k - 2] 

(c) 192(4-1 + 3(2)-l-4(3)-l)u[fc) ( d ) 2[ 4 -(fc-2) + 3(2)-< fc “ 2 > — 4(3)-< fc - z )]u[A= — 2] 

(a) 7T5 0>) rail < c > ( d > 

(a) [§<5[k] — (—1)1 + |(— 2)l]u[fe] (b) (2 + 3fc)(-l)i U [fc[ (c) 5.099(+)l cos( Jk - 1.373)u[fc] 

r, 1 e- fcT - e - T < 2fc + 1 ) r, i 

ym = ir^r u[k] 

(a) 0.8 < |z| < 2 (c) 10 (z 2_^ +0 . 72 0.8 < [z[ < 0.9 (e) M > 0.8 

(a) (e -2 i — 2 fc )u[fc] (b) e- 2 iu[k] + 2l u [-(k + l)] (c) (-e~ 2 i + 2 fc )u[-(k + 1)] 

(a) [0.477el-0.068(-0.2)l-0.412(0.8)i]u[fc] (b) [£(-0.2)1 + §(0.8)l]u[k] + 0.758(2)l U [-(k + 1)J 
(c) The sum of (a) and (b) 11.7-4 [^(-0.2)1 + f (0.8)1 + 0.758(2)l]u[fc] + fu[-(fc + 1)] 

y[fc] = oo 


Chapter 12 


W = TTTa-kscosii - = -‘an-MTS&l + ' ' 

(«) = l 2.02ae-2l 4 2^°o+y 3 n 2co 5 20 ] 1/2 ^"1 = tan- 1 [ fgg 2 » : ; ■»£» - 

tan-M ^^n+o .a l <«> 1^11 = 4cos § + cos f + 2cos f , lH\ e i n \ = -2.50 

( a ) iWl = t 1 ^-^ ] 172 . LBW = ‘an- l (^?gri) - 

(b) 2.86 cos (0.5k - 1.6725) 12.1-5 (a) F h = £ = 57772 = 10 kHz ( b ) T, > 2T h = 100 kHz, 

T < 4 - = 10 ps. 12.2-2 (c) BW = 2TSI H z 12.2-3 H[z] = 3 20 T(i-a 2 -V2 a )(z 2 -^z+i) 

■'a i 1 z^ — V2az-f-a^ 

(a) For T = ,/3S0. H[z] = 

= = M<f 

(a) (b) F arbitrary 12.5-5 (b) H[z] = 1=^ (c) H[z] = ^ 

(a) H[z] = ^f=i (b) | H[ei“T) = f | tan if | (d) T = 25 ps. 


z 2 — %/2az-f-a 2 


J — T z+1 V”/ L®' J — ua,il Tl v 1 -*; ^ ^ 

0.09057(z+l) a , _ 0 0512(zH-l) 2 , _ 0.3203(z-l) 3 

z 2 — 0. 9871 z +0.3493 l 2 ’ 6-4 43 l z J 177X355^+06125 l 2 - 6-5 H[z] _ j3_ 0 ,9102z 2 +0.5545z-0.0979 


1 _ 0.3619(z — l) 2 

1 i z 3 —0.4 169z 2 +0.4054 


12.6-7 H[z] 


"W = ■ z 4 -2.821z4°3 4 5 2 0 3 7 5 ^:2 ) 231z + 0.6416 


z 4 - 2. 5503z 3 +2. 7876z 2 - 1 . 553z+0.394 

> cq mi _ 0.4175 (z 2 -1.4712z-H) 2 

1 J z 4 - 1 .85 7z 3 + 1 . 538z 2 -0.9003z+0.3498 


h[k ] = ^^- 5 ) i s ‘ n - 5) — sin 1.6(fc - 5)] 0 < k < 10. 

ff l z l = I EL-7 (* odd )> W Ham[z)= f EL-7i^°- 54 + a46cOS T E ^ Z_fc 

b[k[ = §=[-0.2885, 0.3140, -0.3779, 0.5282, -1.0137, 0, 1.0137, -0.5282 , 0.3779, -0.3140, 0.2885). 

Chapter 13 

(a) XI = X2, ±2 = -2xi - 10X2 + / (b)xi = X2, X2 = -2e*iX2 - logxi + / (nonlinear) (c)xi = 
X 2 , X 2 = — 4 >y{x\)x 2 — 4> 2 {x\)x\ + / (nonlinear). 

XI - -3X1-X2+/, X2 — -|xi-|x 2 -f §/ 13.2-3 XI = - 5 xi+X 2 + 5 /l, X 2 = ~-2xi — 2 x 2 + 2 /l — 2/2 

xi = — xi-f ^ + 4* V = +/ 13.2-6 xi = -10xi+5x2, X 2 = — 2 x 2 — X 3 +/, £3 = xj— X 3 , y — xi 

X! = A 1 X 1 , X 2 = A 2 X 2 + flj X3 = A 3 X 3 + / 2 , X 4 = A 4 X 4 + / 2 , yi = XI + X 2 , V2 = ^2 + 2:3 
Controller Canonical: xi = X 2 , X 2 = — 12xi — 7 x 2 + /, y = 10xi + 3 x 2 , Observer canonical: xi = 
- 7 xi+X 2 + 3 /, X 2 = -12xi + 10/, y = x\ Series: xi = — 4 xi— 9 x 2 + 10 x 2 + 3 /, x 2 = — 3 x 2 +/, y~x \ 
Parallel: xi = -4xi + /, x 2 = -3xi + /, y = 2xi + X 2 

(6e -t - 4e“ 2t )u(t) 1 -34.02e~ 2t + 39.03e" 3t - 0.01 cos lOOt ' 

13.3-2 

(-3e“* + 4e"“ 2t )u(i) J 17.01e“ 2t - 13.01e~ 3t 

(—1 — 2e -t + 3 e~ 2t )u(t) 13.3-6 (2 + 2e~* cost — e -t sini)u(£) 

"W = TOSI5 I®-®-" 


h(t ) = (e 34 + 2e 4t )u(t) 13.3-18 h(t) = 6(t) + (e * sin f + e 1 cos t)u(t) 

u>i —2 1 u>i 1 w\ 2 1 " xi ’ 

= + / 13.4-2 = 

W2 —3 1 W2 — 1 W2 11 X 2 

y(t) = (§ + ie“ 21 + §e- 3 ‘) 


0 1 1 r wi 


3 5j I VJ2 
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Index 


Abscissa of convergence, 369 
Acceleration error constant, 443 
Active circuit analysis, 406 
Additivity property, 79 

Aliasing (spectral folding), 327, 338, 346, 347, 
557, 734, 735, 740, 742 
Amplitude modulation, 260, 277-289 
DSB-SC, 277 
SSB-SC, 286 

Amplitude response, 472, 717 
Amplitude spectrum, 194, 239, 619, 628 
Analog signals, 58 
Analog systems, 87 

Analog to digital (A/D) conversion, 58, 332 
Angle modulation, 289 
bandwidth of, 296 
demodulation of, 299 
generation of, 298 
instantaneous frequency of, 291 
narrowband, 297 

wideband, 297 Anti-aliasing filter, 327 
Anticausal signal, 59, 449 
Aperiodic signals, 58 
Asymptotically stable system, 148, 603 
Autocorrelation function, 182 

Bandwidth, 212, 248 
essential, 276, 737 
of angle modulated signals, 296 
Bhaskar, 4 

Bilateral Laplace transform, 362, 449 
Bilateral z-transform, 659-662, 668, 704 
Bilinear transformation, 740 
prewarping inherent in, 743 
simplified design procedure, 748 


choice of sampling interval T in, 742 
Binary code, 332 
Bit (binary digit), 332 
Block diagrams, 411 
Block filtering, 655 

overlap and add method, 655 
overlap and save method, 658 
Bode plots, 477 
Bocher, M., 206 
Bombelli, Raphael, 4 
Bounded-input, bounded-output (BIBO) 
stability, 152, 608 
Break (corner) frequency, 481 
Butterworth filter, 501, 505-513, 

Cardano, Gerolamo, 3 
Carrier, 260, 277 
Causal signal, 59 
Causal systems, 84 
Cayley-Hamilton theorem, 42 
Characteristic equation, 43, 107, 579, 804 
Characteristic modes, 107, 579 
Characteristic polynomial, 43, 107, 579 
Characteristic roots 107, 579, 804 
complex, 108, 579 
repeated, 107, 149, 579, 604 
Characteristic value, 107, 579, 804 
Charge coupled device (CCD), 567 
Complete set, 184, 185 
Complex frequency, 73 
Complex frequency plane, 73 
Complex numbers, 1 
algebra of, 4 

arithmetical operations of, 11 
origins of, 2 


Continuous-time system, 87 

forced response of, 139, 140 
frequency response of, 471 
Laplace- transform analysis of, 365, 394 
natural response of, 139, 140 
realization of, 414 
stability of, 148 
state equations of, 788 
time-domain analysis of, 104, 804 
transfer function of, 394 
zero-input response of, 80, 106, 392 
zero-state response of, 80, 118, 392 
Control systems, 426 
analysis of, 429, 434 
design specifications of, 433 
error constants in, 443 
stability considerations in, 448 
Controllability, 93, 818, 830 
Convolution, 120 

circular (or periodic), 349, 644, 651 
graphical understanding of, 127 
properties of, 121 
Table of, 125 

Convolution sum, 587, 366, 683 
graphical procedure of, 592 
properties of, 587 
sliding tape algorithm of, 594 
Table of, 590 

Corner (break) frequency, 481 
Correlation, 177 

application to signal detection , 179 
coefficient , 177 

convolution, comparison with, 182 
functions, 181 
Cramer’s rule, 22 
Cubic equation solution, 3, 49 

Data truncation, 300, 340 
Damping ratio, 434 
Decimation (downsampling), 561 
Decimation-in-frequency algorithm, 356 
Decimation-in- time algorithm, 353 
Decomposition property, 80, 105 
Deconvolution, 615 
Demodulation 


of AM, 284 

of angle modulated signals, 299 
of double sideband (DSB-SC), 280 
of single sideband (SSB-SC), 286 
Diagonal matrix, 35 
Difference equation, 564, 573 
classical solution of, 598 
z-transform solution of, 685 
iterative solution of, 574 
time-domain solution of, 578 
Decibel, 478 

Differential equation, 104 

time-domain solution of, 106 
classical solution of, 139 
Laplace transform solution of, 394 
Differentiation table, 49 
Digital communication, 332 
Digital filters, 541, 567, 716, 729 
advantages of, 567 
nonrecursive, 574n, 756 
recursive, 574n, 729 
Digital signals, 58 
Dirichlet conditions, 195, 240 
Discrete Fourier transform (DFT), 217, 340, 
643 

properties of, 347, 643 
Discrete-time Fourier series (DTFS), 617 
Discrete-time Fourier transform (DTFT), 627 
properties of, 633 
Discrete-time signal, 57, 617 
Discrete-time sinusoid, 546 

highest rate of oscillation of, 555 
nonuniqueness of, 550 
peculiarities of, 547 
periodicity condition in, 548 
reduced frequency of, 551 
Discrete-time systems, 87, 573, 668 
forced response of, 597, 598 
frequency response of, 716 
natural response of, 597, 598 
realization of, 693 
stability of, 603 
state equations of, 823 
time-domain analysis of, 573 
transfer function of, 372 
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z-transform analysis of, 353 
zero-input response of, 578, 689 
zero-state response of, 213 
Distortionless transmission, 268 
Distributed-parameter system, 87 
Downsampling (decimation), 561 
Duality property of the Fourier transform, 253 
Dynamic systems, 84 
Dynamical equation, 787 

Eigenvalues, 42, 107 
invariance of, 813 
of a matrix, 42, 804 
Energy signals, 60 
Energy spectral density, 275 
Envelope detector, 284 
Equal ripple functions, 515 
Error constants in control systems, 443 
Essential bandwidth, 276, 737 
Euler formula, 6, 19 
Even function, 75 
Everlasting exponential, 73, 249 
Exponential Fourier series, 206 
External description of a system, 92 

Fast Fourier transform (FFT), 217, 352 
Feedback systems, 426 
negative, 429, 448 
positive, 429, 448 
Filters 

allpass 535 

bandpass, 501, 505, 526, 725, 752 
bandstop (notch), 502, 505, 531, 727, 752, 
Bessel Thomson, 535 
Butterworth, 501, 505 
Chebyshev, 501, 514 
elliptic, 523 

frequency sampling, 771 
frequency transformations in, 524 
highpass, 503, 505, 524, 725, 750 
ideal, 270 

inverse Chebyshev, 522 
lowpass, 500, 505, 725 
nonrecursive, 730, 756, 761, 771 
recursive, 729, 734, 740 


passband of, 504 
stopband of, 504 

Final value theorem, 410, 685 
Finality property of Fourier coefficients, 186 
First-order hold, 324, 358 
Folding frequency, 327, 558 
Forced response, 139, 140, 597, 598 
Fourier, Jean-Baptiste-Joseph, 187 
Fourier integral, 237, 627 
Fourier series, 185, 189, 206 

Dirichlet conditions for, 194, 195 
exponential, 206 
generalized, 185 
symmetry conditions in, 198 
trigonometric, 189 
Fourier spectra 

of continuous-time Fourier transform, 239 
of discrete-time Fourier series, 619 
of exponential, 208 
trigonometric, 194 
Fourier transform, 240, 627 

duality (symmetry) property of, 235 
existence of, 239 

frequency-convolution property of, 263, 
634 

frequency-shifting property of, 259 
linearity of, 240 
numerical computation of, 338 
physical appreciation of, 240 
scaling property of, 255 
Table of, 252 

time convolution property of, 263 
time differentiation property of, 264 
time integration property of, 264 
time shifting property of, 257 
Frequency division multiplexing (FDM), 300 
Frequency-domain analysis, 

of continuous-time systems, 243, 244, 361, 
365 

of discrete-time systems, 660, 668 
of state equations, 811, 829 
Frequency modulation, 289 
Frequency resolution, 340, 343 
Frequency response, 471, 716 


Frequency sampling filters, 771 
Frequency shift keying (FSK), 295 
Frequency-shifting property, 259, 349, 385. 
634, 644 

Frequency spectra, 194, 239, 619, 627 
Fundamental frequency, 189, 551 
Fundamental frequency range, 551 

Gain crossover frequency, 491 
Gate function, rect(t), 245 
bandwidth of, 248 
Generalized Fourier series, 185 
Gauss, Karl Friedrich, 3 
Generalized function, 71 
Gibbs phenomenon, 205, 765 
Gibbs, Willard, 204, 205 

Half-wave (rotational) symmetry, 199, 230 

Hamming window, 304, 305, 766, 769 

Hanning (Von Hann) window, 304 

Harmonic frequency, 189 

Heaviside, Oliver, 379 

Homogeneity property, 79 

Hybrid (sampled-data) systems, 697 

Ideal filters, 270, 

Impulse function, 69 

sampling (sifting) property of, 71 
Impulse invariance method, 734 
Impulse response, 115, 120, 137, 263, 390, 583, 
587 

Impulse response matrix, 810 

Information transmission rate, 158 

Initial conditions, 78, 111, 142, 392, 574, 688 

Initial condition generators, 400 

Initial state, 785 

Initial value theorem, 410, 685 

Input, 77 

Instantaneous frequency, 290 
Instantaneous (memoriless) systems, 84 
Integral control, 447 
Integration table 48 
Interpolation, 323, 561 

first-order hold, 324, 358 
ideal, 324 


simple (zero-order hold), 323, 358 
Inverse discrete Fourier transform, 341 
Inverse Fourier transform, 238 
Inverse Laplace transform, 364 
Inverse z-transform, 661, 669 
Iterative solution of difference equation, 574 

Lag compensator in control systems, 447 
Laplace, Marquis Pierre-Simon, 379 
Laplace transform, 361 

abscissa of convergence of, 369 
bilateral, 361, 449 
existence of, 369 

frequency-convolution property of, 388 
frequency-shifting property of, 385 
inverse, 364, 371 
linearity property of, 365 
physical interpretation of, 365 
region of convergence, 366, 367, 451 
scaling property of, 388 
Table of, 372 

time convolution property of, 388 
time differentiation property of, 385 
time integration property of, 387 
time shifting property of, 382 
unilateral, 367 

Lead compensator in control systems, 446 

Leakage, 303, 340 

Left half plane (LHP), 74 

Legendre polynomials, 187, 232 

L’Hopital’s rule, 46 

Linear system, 79 

Log magnitude, 478 

Lower sidebands, 278 

Linear time-invariant system, 83 

Lumped-parameter system, 87 

Maclaurin series, 46 

Marginally stable system, 148, 396, 603 

Matrix, 34 

algebra of, 36 

characteristic equation of, 43, 804 
derivative and integral of, 41 
eigenvalues of, 42, 803 
identity, 35 
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impulse response, 810 
nonsingular, 40 
state transition, 807 
Maximally flat response, 506, 534 
Mean-squared error, 53 
Memoriless system, 84 
Michelson, Albert, 205 
Modified z-transform, 703 
Modulation, 260, 277, 289 
Multiplexing 

frequency-division, 262, 301 
time-division, 331 

Natural frequencies, 107 
Narrowband angle modulation, 297 
Natural response, 139, 140, 597, 598 
Noncausal system, 84 

approximate realization of, 86 
Nonrecursive filter, 730, 761, 771 
Normal form equations, 787 
Null function, 368n 

Numerical computation of Fourier coefficients, 
216 

Nyquist interval, 321 

Nyquist plot, 491 

Nyquist rate of sampling, 321 

Observability, 93, 818, 830 
Odd function, 75 
Operational amplifier, 406, 422 
Operators, 

advance, 577 
differential, 89 
Orthogonal signal set, 183 
Orthogonal vector set, 183 
Orthogonality, in complex signals, 175 
Orthogonality in real signals, 174 
Orthonormal set, 184 
Output, 77 
Output equation, 786 

Paley-Wiener criterion, 271 
Parseval’s theorem 

for Fourier series, 186, 214 
for Fourier transform, 275 


for discrete-time Fourier series 664 
for discrete-time Fourier transform 635 
Partial fraction expansion, 24, 371, 675 
modified, 33 
Passband of a filter, 504 
Peak time, 431 
Percent overshoot, 431 

Period of a continuous-time periodic signal, 15, 
59, 200 

Period of a discrete-time periodic signal, 548 
Periodic signal, continuous-time, 58, 

Periodic signal, discrete-time, 548 
Periodicity condition in discrete-time signals, 
548 

Phase crossover frequency, 491 

Phase- locked loop (PLL), 299 

Phase modulation, 289 

Phase response, 268, 472, 717 

Phase shift keying (PSK), 295 

Phase spectrum, 194, 239, 619, 628 

Picket fence effect, 340 

Polar plot, 491 

Power signals, 60 

Position error constant, 443 

Probabilistic signals, 60 

Pulse amplitude modulation (PAM), 331 

Pulse code modulation (PCM), 332 

Pulse dispersion, 158 

Pulse position modulation (PPM), 331 

Pulse width modulation (PWM), 331 

Pythagoras, 2 

Quadratic equation solution, 49 
Quantizing, 332 

Random signals, 60 

Rectangular window, 302, 305, 650, 763, 
Recursive filter, 729, 734, 740 
Regenerative repeater, 334 
Region of convergence, 362, 366, 367, 451, 670, 
704 

Right half plane (RHP), 74 
Rise time, 156, 431 
Rolloff rate, 303 
Root locus, 438, 439 


Sallen-Key circuit, 408 
Sampled-data (hybrid) systems, 697 
Sampling (sifting) property of impulse func- 
tion, 71 

Sampling rate (frequency), 321, 558 
Sampling theorem, 319 
applications of, 331 
dual of, 336 

Scaling property, 255, 388 
Sidebands 

double, 277 
lower, 278 
single, 286 
upper, 278 
Sidelobes, 303 
Signals 

analog, 58 
aperiodic, 59 
comparison of, 177 
continuous-time, 57 
detection of, 179 
digital, 58 
discrete-time, 57 

distortion during transmission of, 268 
energy, 60 

energy of, 52, 274, 556 

essential bandwidth of, 276, 276n 

periodic, 58 

power, 60 

power of, 52 

representation by orthogonal basis signals 
of, 183 
size of, 52 

Signum (sign) function, sgn(t), 251 
Sine function, 246 
Single sideband signals 
generation of, 288 
demodulation of, 286 
Sinusoids, continuous-time 14 
Sinusoids, discrete- time, 546 
Spectral folding (aliasing), 327, 338, 346, 347, 
557, 734, 735, 740, 742 
Stability of a system, 147, 396, 603 
asymptotic, 148, 396, 603 


bounded-input, bounded-output (BIBO), 
152, 608 

marginal, 148, 396, 603 
State equations, 784, 824 

derivation from transfer function of, 791 
frequency-domain solution of, 799 
of electrical circuits, 788 
time-domain solution of, 804, 825 
State transition matrix, 807 
computation of, 807 
State variables, 784 

selection of, for electrical networks, 788 
State vector, 788 

linear transformation of, 811 
Steady-state error, 431, 441 
Steady-state response, 476, 717 
Stopband of a filter, 504 
Strip of convergence, 451 
Superposition principle, 79 
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